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■ I. Introduction 

In a broadcast (BC) channel a single transmitter sends messages to multiple receivers [1]. These 
messages may be common to all receivers, or particular to an individual receiver or a subset of receivers. 
The vector containing the rates of these messages is said to be achievable if each receiver is able to 
reliably decode its intended messages. The closure of all such vectors is usually referred to as the 
capacity region [2]. 

The first author is with the Communications Research Centre, Ottawa, Ontario, Canada, ramy.gohary@crc.gc.ca. The second 
author is with The Department of Electrical and Computer Engineering, McMaster University, Hamilton, Ontario, Canada, 
davidson@mcmaster.ca. 



November 3, 2009 



DRAFT 



2 



A special class of BC channels is the one in which the received signals form a Markov chain. In this 
case, the received signals are said to be degraded versions of each other, and the degradation level of 
each signal is given by its order in the Markov chain. For the class of degraded channels, superposition 
coding [3] is known to attain every point on the boundary of the capacity region in the general unrestricted 
case [4], and in the case of Gaussian channels with a power constraint [5]. 

If the received signals do not form a Markov chain, the BC channel is said to be non-degraded, 
and the coding scheme developed in [3] does not apply directly [6]. Although degraded channels are 
useful in modelling single-input single-output BC systems, many practical systems give rise to non- 
degraded channels, including those that employ multicarrier transmission [7], and the class of multiple- 
input multiple-output (MIMO) systems [6], [8]. 

Most of the studies on non-degraded BC channels have focused on the case in which only independent 
particular messages are sent to the receivers, e.g., [6], [8]-[16]. For example, the sum capacity for the case 
in which particular messages are broadcast over Gaussian MIMO channels was studied in [15] and [16] 
and was shown in [8], [12], [13] to be achievable by dirty paper coding (DPC) [17] with Gaussian 
signalling. Later, it was shown in [6] that DPC with Gaussian signalling is sufficient to attain every point 
in the achievable rate region. That is, DPC with Gaussian signalling is sufficient for achieving every 
point in the capacity region of the Gaussian MIMO BC channel with particular messages. 

In contrast to the case of particular messages only, there has been less progress in characterizing the 
capacity region of general non-degraded BC channels when common or partially common messages are to 
be transmitted along with particular messages. However, some partial results are available. For instance, 
for the case in which common messages may be transmitted over general non-degraded BC channels, 
characterizations of achievable inner bounds were obtained in [18], [19] and [20], and characterizations of 
outer bounds were obtained in [21]. In addition, characterizations of the capacity region of a BC channel 
with two receivers, two unmatched parallel degraded components, a common message intended for both 
receivers and a particular message intended for each receiver were provided in [22]. For a BC channel 
with three receivers, a common message and one particular message, a single-letter characterization 
of the capacity region was provided in [23] and this region was shown to be strictly larger than the 
one conjectured in [24]. For general BC channels in which common, partially common and particular 
messages are intended for the receivers, fundamental constraints on the geometry of the capacity region 
were provided in [25]. 

In this paper we consider a different class of BC channels with three receivers. In contrast to [23], in 
which there is only one particular message, in the class considered herein a particular message is sent to 
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each of the three receivers, in addition to the common message. The channel is assumed to be Gaussian 
and memoryless with two unmatched degraded components. It will be shown that for the degradation 
orders considered in this paper, superposition coding and Gaussian signalling are sufficient to attain any 
point on the boundary of the capacity region. 

Our methodology for obtaining this result involves three stages. First, we provide an ostensibly 
relaxed characterization of the rate region that can be attained by superposition coding and Gaussian 
signalling. Using the Karush-Kuhn-Tucker (KKT) optimality conditions, this relaxation is shown to be 
tight. Second, we use information-theoretic analysis to obtain bounds on any achievable rate vector. 
Finally, by combining the tight relaxation and the information-theoretic bounds, we establish the desired 
converse, i.e., that every achievable rate vector can be attained by superposition coding and Gaussian 
signaUing. 

The paper is organized as follows. In Section JI] we describe the system model considered in this 
paper along with necessary definitions and notations. In Section |lll] we provide a characterization of the 
rate region that can be achieved by superposition coding and Gaussian signalling, and in Section |W] we 
express the boundary of this region as an optimization problem. In Section |V] we consider a relaxation of 
the optimization problem in Section |IVl In Section |Vl] we provide common solutions for the KKT 
conditions that correspond to both the original and the relaxed optimization problems. Using these 
solutions, in Section IVIII we establish the tightness of the relaxation in Section |Vl In Section I Villi 
we obtain information theoretic bounds on the achievable rates and in Section |lXl we employ the entropy 
power inequality to the bounds of Section IVIII I The resulting inequalities are then identified with the 
relaxed characterization of the superposition coding and Gaussian signalling rate region developed in 
Section |Vl This identification is then used in Section |IX] to establish the main result of the paper. That 
is, the optimality of superposition coding and Gaussian signalling. Section |X] concludes the paper. For 
clarity of exposition, most of the proofs are relegated to the appendices. 

Notation: The paper uses conventional notation throughout. Vectors are denoted by regular weight 
symbols, and subscripts and superscripts are used to refer to particular entries of these vectors. 

II. System Model 

We consider the discrete-time BC channel depicted in Figure [T] For this channel the transmitter sends 
messages to three receivers over two parallel unmatched Gaussian memoryless degraded subchannels. The 
transmitted signal on subchannel i is denoted by Xi and its power is denoted by Pi. The signal observed 
by receivers Y, Z and W on the i-th subchannel is denoted by Yi, Zi and Wi, i = 1,2, respectively. 
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Fig. 1. A BC channel with 2 unmatched degraded components and 3 receivers. 



The variance of the Gaussian noise at degradation level j on subchannel i is denoted by N- , where 
< iV/^^, i,j = 1,2. The transmitter wishes to send particular messages of rates Ri, R2 and i?3 to 
receivers Y, Z, and W, respectively, and also wishes to send a common message of rate Rq to all three 
receivers. We will show that, for the scenario in Figure [T] the region of rate vectors {Rq, Ri, R2, R3) that 
are achievable using superposition coding and Gaussian signalling is the region of all achievable rates, 
i.e., the capacity region. 

The description of the set of rates that are achievable by superposition coding (SPC) is parameterized 
by a set of power partitions, cf. [22]. Each partition determines the fraction of the transmission power 
that is used to transmit the incremental message to the next less degraded receiver on each sub-channel. 
Since power partitions on each subchannel lie in the unit simplex in M.^ we need only specify two of them 
on each subchannel. Given this vector of partitions, a = [a}, , 02], where aj > and aj + af < 1, 
the following definitions will simplify the description of the SPC achievable rate region 

,,,Al, I ( Nl + P2 \ 

= 2 ^°<^V^) + 2^°H iV3 + (,i + ^2)pJ . (lb) 

/012(a) = Ma) + -log{ \2l^.;^ )^ (ic) 

/0123(«)^ /012(a) + ilog(^^i±^), (Id) 

,,Al. ( iVf + Pi ^ , 1, ( iV| + P2 \ . 

..Al, ( iVf+Pi ^ , 1, (Nl + P2\ 
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5012(a) = 902(a) + 2 log j, (Ig) 



= g02(a) + -log( 
50123(a) = c/oi2(a) + - log(^ ^^^^ j = 5023 (a) + - log' 



5023 (a) = go2 (a) + - log ( ^1 J ' (Ih) 



ATI 



(li) 



= 2^°<iV3 + (a} + af)pJ + 2l°<iVKMT^)' ^'^^ 

= 2'< Nf + ia\ + al)pJ + 2^°<^Vj-)' ^^^^ 
/t023(a) = /103(a) + - log ATf + alPi ^ 

/toi23(a) = /to23(a) + 2 l°g(, Ni — )• ^^^^ 



'1 

III. An achievable Rate Region 

In this section we will characterize the set of rates that are achievable by superposition coding (SPC) 
for the BC channel depicted in Figure [T] 

First, let us consider the case in which the transmit powers Pi and P2 are given. By applying the 
fundamental principles of superposition coding [1], [3], and by coding the common message jointly over 
the sub-channels [22] and coding the components of the particular messages that are transmitted on each 
sub-channel separately [22], it can be shown that a rate vector R can be achieved using superposition 
coding (and Gaussian signalling) with the power partitions 6 if the following inequalities are satisfied: 

Ro<fo{e), Ro + Ri<foi{e), Ro + Ri+R2<f 012(0), (2a) 

Ro + Rl+R2 + R3<f 0123(0), (2b) 

Ro<go(0), Ro + R2< 902(0), (2c) 
Ro + Ri + R2< 9012(0), (2d) 

Ro + R2 + R3< 9023(0), (2e) 

R0 + R1+R2 + R3 < 50123 (0) , (2f) 

Ro<ho(0), Ro + R3<ho3(0), Ro + R2 + R3<ho23(0), (2g) 

Ro + Ri + R2 + R3<hou3(0), (2h) 

Rk>0, A: = 0,1,2,3, (2i) 

G S, (2j) 
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where 

s^{e\ef>o,e} + ef<i,i = i,2}. 0) 

In the derivation of the constraints in ([2]) we have used the fact that for the BC channel shown in Figure [T] 
the constraints 

Ro + Ri + R3< km + \ log(il±M±^) , (4a) 
R, + R, + R,< horn + \ log(^l±4^^) (4b) 



are redundant. To show that (I4al) is redundant, we observe that 
hi (^) + log = /oi (^) + - log + 77 log ' 



2 ATI ; -""^ ' ' 2 N^ + 0lP2 J 2 ^\ Nl 

= /oi23(9), (6) 

where in ^ we have used the fact that logf ^jyi_^gi ^ ) is monotonically decreasing in A'^l, and 
that N\ < Now, for any R2 > 0, the left hand side of ( |4al ) is strictly less than the left hand side 
of the inequality in ( [2bl ) and the right hand side of ( |4al ) is strictly greater than the right hand side of 
the inequality in (l2bl ). Hence, we conclude that the last inequality in (l2bl) is strictly tighter than the 
inequality in ( |4a| ). and hence the redundancy of ( |4al ). A similar argument involving (l2hl ) can be used to 
show that ( [4bl ) is also redundant. 

To facilitate the analysis of the rates and partitions that satisfy the inequalities in we will expurgate 
a set of partitions, Sn, that do not yield rates on the boundary of the region described by The set of 
rates on the boundary of the region characterized by (H) can be expressed as the set of rates generated 
by the optimization problem 

3 

max yjffc-Rfe, subject to the constraints in ©, (7) 

k=0 

for all non-negative weight vectors v € M^. We will refer to the rate vector generated by ^ for a certain 
power partition 9 and a weight vector v, as R*{6, v). The set Sn of partitions that do not solve ^ for 
any weight vector v can be written as 

3 3 

= {^iVu € M^,3^9 G 5 such that ^^VkRUe^v) < '^VkRl{-d,v)y (8) 

fc=0 fc=0 

By definition, excluding Sn from the set of feasible power partitions in Q does not affect the set of 
rates that are achievable by superposition coding and Gaussian signalling. 
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We now define equivalence classes of power partitions. In particular, the partition 9 is said to be 
equivalent to the partition ?? with respect to v if and only if R*{9,v) = R*{'d,v). The set of partitions 
that are equivalent to 9 for a given weight vector, v, can be denoted by [9]^ and can be represented by 
9y. If we restrict the set of feasible partitions to the quotient space {S \ 5jv)/~, the set of rates that are 
achievable by superposition coding and Gaussian signalling remains the same as that generated by the 
constraints in (O for all ^ S. Furthermore, restricting our attention to partitions in 

S = \^0^\v(£R^^ (9) 

yields the following result, which we will use in Section |IVl 

Lemma 1: The restriction of the power partitions to 5 in (|9l) rather than .S in ((31) establishes a one-to-one 
correspondence between points on the boundary of the rate region that can be achieved by superposition 
coding and Gaussian signalling and the power partitions that enable these rates to be achieved. □ 

Now, let us define the SPC-Region for a given power allocation (Pi , P2 ) to be the region containing 
partition-rate vectors {9, R) such that the rate vector R is achievable using superposition coding with the 
power partitions specified by 9. More precisely, le|3 

SPC-Region(Pi, P2) = {{0, R) \ constraints satisfied, 9 eS}. (10) 

The association of partitions with rates is introduced to enable us to express the SPC-Region as the 
intersection of two regions, namely, Regioni and Region2, below. For a system in which the transmission 
powers Pi and P2 may be allocated arbitrarily, subject to a total power constraint of the form P1+P2 < P, 
the complete SPC-Region is 

IJ SPC-Region(Pi,P2). (11) 

Pl,P2>0,_ 
Pl+P2<P 

Now that we have a characterization of the SPC-region, the rest of the paper is focused on establishing 
the converse. Given the structure of the expression in (fTTI ). to establish the converse it is sufficient 
to consider each power allocation (Pi,P2) separately, and to show that for every rate vector R that 
is achievable with a given power allocation there exists a vector of power partitions, 9, such that the 
inequalities in ^ are satisfied, i.e., such that {9,R) G SPC-Region(Pi, P2). Since we will deal with 
each power allocation separately, we will simplify our notation and drop the explicit dependence of the 
SPC-Region on Pi and P2. 

'Note that the case in which either Pi or P2 is zero corresponds to a degraded channel case for which the entire rate region 
has been fully characterized [2]. Therefore, henceforth we will assume that both Pi and P2 are strictly greater than zero. 
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In our development of the converse, we will show that for any rate vector R that is achievable with 
transmission powers Pi and P2 there exist power partitions 9' and 9" such that 

{6', R) G Region^ = { (9, R) j constraints (|2a|-(l2ill \ d^ejl satisfied, 9 eS], (12a) 
{9", R) G Regiong = {{9,R)\ constraints (|2all-(l2ill \ dldll satisfied, 9 eS}, (12b) 

where \ denotes the removal of a constraint. Hence, Regioni contains all the achievable rates, as does 
Region2, and thus so does their intersection. This intersection can be written as 

Region^ Region2 = | {9, R) constraints (Hill-dlill \ (|2ell |J (Ea])-© \ ^ satisfied , 6* G cSj (13a) 

= { {9, R) I constraints (l2ab-(l2il) satisfied, 9 e S}, (13b) 

which is the SPC-region in (fTOl ). In the remainder of the paper we will focus on showing that every 
achievable rate vector is contained in Regioni. By exploiting symmetry, a similar argument can be used 
to show that Region2 also contains every achievable rate vector, and we will provide some of the details 
of that proof as they arise. 

IV. The boundary of the SPC-Region as an optimization problem 

Lemma [T] implies that points on the boundary of the (partition-rate) SPC-Region can be found by max- 
imizing weighted-sum-rates and associating with each rate vector a partition that achieves it. Using ([T3] ). 
we will find the boundary of the SPC-Region by considering the boundaries of Regioni and Region2 
separately. First, we observe [22], [26] that any achievable common information rate, Rq, must satisfy 

A 



where C{x) = ^ Iog(l + x). The arguments of the minimization in ([14)) are the maximum rates that can 
be communicated to receivers Y, Z and W, respectively. 

A. Characterizations of Regioni and Region2 

Let Rq be a common information rate that satisfies ([141 ) and let 9' and 9" be the power partitions that 
are used to characterize Regioni ^"^^ Region2 in ( |12a| ) and ( il2b| ), respectively. Consider the partition-rate 
regions with the following boundaries. In particular, for Regioni we consider 
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(j U <^ {9',Ro,Ri,R2,R3) {e',R^,R2,R3) 



-Roe[0,Ro,max] W,>0 



arff max 



,9' 



3 

EWkRk 

k=l 



subject to 



\ (EH), 9' eS 



(15) 



and for Region2 we consider 



U U \ i^" ' ^0, Ri, R2, R3) {0" , Ri, R2, R3) 



-Roe[0,-R.O,„ax] W,>0 



are max 




subject to (Eil-dlill \ dM, 6*" e 5|. (16) 

Remark 1: The (partition-rate) SPC-Region can be constructed from the intersection of the region 
bounded by (flSl ) and that bounded by ([T6l ). In particular, the boundary of this region can be constructed 



by the problem in ([T5] ) is feasible for the problem in (fT6l ). Then the partition 9' is a representative of an 
equivalence class of partitions that maximize the weighted sum-rate, and we can choose this partition to 
be the representative in S. If, however, the partition-rate vector generated by ([T5] | does not belong to the 
feasible set of (fT6l ). then taking the intersection of the region bounded by (fTSl ) and the region bounded 
by ([T6l ). analogous to ( fT3] ). eliminates such a vector. A particular instance in which we implement this 
intersection will be considered in Remark |2] below. □ 
Given the observation in the above remark, we will henceforth refer to the region bounded by (ITSl ) as 
Regioni and that bounded by (fT6b as Region2. 

B. KKT necessary optimality conditions for (1151) 

In this section we will analyze the characterization of Regioni in (fTSl ). The corresponding analysis for 
Regiong follows an analogous path that exploits the symmetry between receivers Y and W in Figure [1] 

In order to expose the structure of Region^ we consider the KKT conditions (cf. [27]) that correspond 
to the optimization problem in ([T5] ). In doing so, we will seek solutions for which ii > 0, > and 
9} + 9f < 1, i = 1,2. Due to the continuity of the rate functions, these assumptions are not restrictive 
because R and 9 can take on arbitrarily small values. Observe that it is not known whether the optimization 



in the following way. Suppose that for a given Rq and given {wk}\^i the partition-rate vector generated 
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problem in ([TS] ) is convex. Hence, for any regular point of the feasible set of ([TSl l. the KKT conditions are 
only necessary for optimality [27]. Using the definitions in ([Hi, and using Lq to denote the Lagrangian 
corresponding to dTS] ). we have 



wi - ipi +P2 + p3) - We + P7) - Pii = 0, (17a) 
W2 - (/?2 + P3) - (/?5 + + P?) - iPw + Pu) = 0, (17b) 

W3-P3-P7-ip9 + Pw+Pu)=0, (IVC) 



dRi 
dLo 
dR2 
dLo 
dRs 

dLo _ {Po + P1+P2+ P3)P2 (/?2 +P3- Pa)P2 P8P2 



001 Nl + {el + 9l)P2 Nl + iel + ei)P2 iv^ + (^2 + ^2)^2 

_ iP2 + P3 + P5 + P6 + P7)P2 (/?3 + P7)P2 ^ 

Nl + elP2 N^ + 9^P2 

dLo _ {Po+Pl+P2+P3)P2 {P2+P3-Pa)P2 /?8^2 

del Ni + {el + el)P2 ^ N^,+{e\ + el)P2 N^ + {e\ + el)P2 ' ^ 

dLo _ -PoPi iPw + Pii - Pa)Pi iPs + P9 + Pio + Pii)Pi _ , . 

dej Nl + {el + el)Pi + ivf + {e\ + el)Pi Nf + {e\ + ej)Pi ' ^ ^ 

aLo _ -PoPi ^ {Pio + Pii - Pa)Pi iPs + P9 + Pio + Pu)Pi 



del Nl + {el + ef)Pi N^ + {el + ej)Pi Nf + {el + ej)p^ 



(/?5 + P6 + P7 + Pio + Pii)Pi , iPe + P7 + Pn)Pi _ ^ . 

A^2 + ^ip, + Nl + elPi ' ^ 

/?o>0, h(.e)>Ro, poiUe) - Ro) = 0, (17h) 

/?i>0, /oi(^) >iio + ^i, Pi{foi{0) - Ro - Ri) = 0, (17i) 



/32>0, /012(e) >i?o + ^^fe, /?2(/oi2(e)-^o-X]^fc) =0, (17j) 

fc=i fc=i 
3 3 

/?3>0, /0123W >i?0 + 5^iifc, /?3(/0123W-^0-^iifc) =0, (17k) 

fc=l A;=l 

Pa>0, go{e)>Ro, P^goie) - Ro) = 0, (171) 
P5>0, 9o2{e)>Ro + R2, P5igo2ie) - Ro - R2) = 0, (17m) 



/?6>0, goi2{e)>Ro + ^Rk, P6{goi2{e)-Ro-^Rk) =0, (17n) 

fe=i fc=i 

3 3 

P7 > 0, goi23{0) >Ro + Yl P7{goi23{0) -Ro-Yl = 0, (17o) 

k=l k=l 

P8>0, hoie)>Ro, psihoie) - Ro) = 0, (17p) 
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(39 >0, ho3{0)>Ro + R3, (3gigo3ie) - Ro - R3) = 0, (17q) 

3 3 
Ao > 0, ho23{d) >Ro + Y,Rk, /9io(/i023 {0) -Ro-Y.^k)= 0, (17r) 

k=2 k=2 
3 3 

/3ii>0, hoi23{0)>Ro + Y,^k, Pn{hoi23{0)-Ro-J2Rk) =0. (17s) 

k=l k=l 

The constraints on the left hand side of (I17hl )- (ll7sl ) are non-negativity constraints on the Lagrange 
multipliers, {/?«}. The middle constraints are the feasibility constraints of the rates and partitions and the 
constraints on the right hand side of (I17hl )- (ll7sl ) are the complementarity slackness conditions [27]. 

V. An outer bound on Regioni 

In this section we provide a relaxation of the optimization problem in (fTSl) . This relaxation will be 
shown to be tight in the sense described in Section I VII I 

Let us introduce three power partition vectors a, a' and a". An outer bound on Region^ can be obtained 
by solving the following optimization problem, in which a is employed in the constraints involving /o, 
/oi> /oi2 and /0123, «' is employed in the constraints involving go, 502, 5012 and (70123, and a" is employed 
in the constraints involving ho, ho3, /io23 and /ioi23- 



max 



^WkRk, (18a) 



k=l 



Ro<Ma), Ro + Ri<foi{a), 


Ro + Ri + R2< /012(a), 


(18b) 


Ro + Ri + R2 + R3< /0123(a), 




(18c) 


Ro < go{a'), Ro + R2< 502(a'), 


R0 + R1 + R2 < 5012 (a'). 


(18d) 


Ro + Ri + R2 + R3< 50123 (a'), 




(18e) 


Ro<ho{a"), Ro + R3 < ho3{a") 


, Ro + R2 + R3<ho23{a"), 


(18f) 


Ro + Ri + R2 + R3< /ioi23(a"), 




(18g) 


>0,fc = 1,2,3, 




(18h) 


a,a ,a Go. 




(18i) 



The optimization problem in (fTSl ) is a relaxation of that in (fTSl ) because (fTSl ) can be made equivalent 
to the problem in (fTSl ) by adding the constraint a = a' = a". Hence, for a given set of weights, the 
weighted sum-rate generated by ([TSl l is greater than or equal to that generated by (fTSl ). However, in the 
following analysis we will show that for all relevant non-negative weights, wi, W2 and W3, and allocated 
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powers Pi and P2, any maximum weighted sum-rate generated by (1181 ) is equal to the maximum weighted 
sum-rate generated by the problem in (fTSl ). 



A. KKT conditions for (1181 ) 

In order to gain insight into the structure of (fTSl) . we consider its KKT optimality conditions. Akin 
to Section |IV-B[ we will consider solutions to the KKT conditions for ( fTSl ) for which for which R > 0, 

(q, a', a") > 0, ELi < 1' ELi «f < 1 and ELi «f < 1- 
Using L to denote the Lagrangian of (fTSl ). we can write the KKT conditions as follows: 
dL 



dRi 
dL 
dR2 
dL 
OR. 



wi - (Aoi + A012 + A0123) - (%i2 + ??oi23) - C0123 = 0, (19a) 

W2 - (A012 + A0123) - (??02 + VOI2 + II0I23) - (?023 + ^0123) = 0, (19b) 
W3 - A0123 - '70123 - (■^03 + ■?023 + C0123) = 0, (19c) 



dL dfoja) dfoija) dfouja) , , dfousja) , „ 

TTT = -^0 r, p + Aoi — hAoi2 — hAoi23 — h /ij = 0, (19d) 



^ Vo ^ ,p + V02 ^ ,p hr?oi2 — ttTp ^%i23 TTTp ^ /^i = (19e) 



daf daf ' daf ' daf ' da'f 



dL , dhoja") ^ dhosja") , dho23{a") , , g/^oi23(«^0 , . ..pn 

~ ?0 „ K?03 ^T-TT K?023 TT-iTf ^ ?0123 ^ /^i = u, (19f) 



aaf daf daf daf daf 

Ao > 0, /o(a) > i?o, Ao(/o(a) - Ro) = 0, (19g) 

Aoi>0, /01(a) > i^o + ^i, Aoi(/oi(a) -iio-^i) = 0, (19h) 

Aoi2>0, foi2{a)>Ro + Ri + R2, XouifoMa) - Ro - Ri - R2) = 0, (191) 
Aoi23>0, /0123(a) > ^0 + ^1 + ^2 + i?3, Aoi23(/oi23(a)-i2o-^i-i?2-i?3) = 0, (19j) 

??o>0, go{a')>Ro, 7]o{go{a') - Ro) = 0, (19k) 

??02>0, 502(a) >i?o + ^2, r,02{902{a') - Ro - R2) = 0, (191) 

??oi2>0, 5oi2(a') >i?o + ^i + ^2, ?7oi2(5oi2(a') - i^o - i^i - -R2) = 0, (19m) 
??oi23 > 0, 5oi23(a') > ^0 + -Ri + -R2 + -R3, %i23(5oi23(a') - -Ro - ^1 - ^2 - -R3) = 0, (19n) 

Co>0, hoia")>Ro, (oihoia") - Ro) = 0, (19o) 

Co3 > 0, ho3{a") >Ro + R3, Co3(/i03(a") - Ro - R3) = 0, (19p) 

C023 >0, /l023(a") > -Ro + -R2 + i?3, Co23 (/i023 (a") " -Rq " ^2 " i?3) = 0, (19q) 
C0123>0, /i0123(a") >fio + -Rl+-R2 + i?3, ^0123 (W (a") " -Ro " -Rl " i?2 " i?3) = 0. (19r) 
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In writing ( fT9l ) we have used Aq, Aqi, Aoi2 5 A0123 to denote the Lagrange multipliers associated with the 
constraints involving a in (fTSl ). r/o, ??02, %12 5 %123 to denote the multipliers associated with the constraints 
involving q', and ■?03) ^023, '^0123 to denote the multipliers associated with the constraints involving a". 

B. Analysis of the KKT system in ( |19l l 

Because of the (partial) decoupling of constraints, it is significantly easier to draw insight into the 
system of equations in ([T9l ) than it is to draw insight into the KKT system for (fTSl ). cf. ([TT] ). In particular, 
we have the following results. 

Lemma 2: Any solution of the KKT system in (1791 ) must satisfy 

Ao = r/o = Co = 0. (20) 
Proof: See Appendix II-AI ■ 
Lemma 3: For any solution of the KKT system in ( fT9l ). either Aqi = A012 = A0123 = or Aqi > 0, 
A012 > and A0123 > 0. 

Proof: See Appendix II-BI ■ 
Lemma 4: For any solution of the KKT system in ([T9l ). either 7702 = %12 = %123 = or ryo2 > and 

?/0123 > 0. 

Proof: See Appendix II-CI ■ 
Lemma 5: For any solution of the KKT system in ( fT9l ). either ^03 = C023 = C0123 = or ^03 > 0, 
^023 and ^0123 > 0. 

Proof: See Appendix II-DI ■ 

VI. Common solutions for KKT conditions in ([17]) and ( fT9l ) 

In this section we use the results in Lemmas |2]-l5] to construct an explicit characterization of solutions 
of the KKT system in ([TT] ) that also solve the KKT system in (fT9l ). In particular, we have: 

Theorem 1 (wi > W2 > w^): Given Rq satisfying (fT4l) and a weight vector with wi > W2 > W3, there 
exists a solution of the KKT system of equations in ([TT] ). (/?, 6, R), with 6 > and R > such that this 
solution solves the KKT system in ( [T9l l with (A, r],^) = P, a = 9 and with identical rates R. 

Proof: See Appendix HIl ■ 

Theorem 2 (w2 > wi > w^): Given Rq satisfying (fT4b and a weight vector with 'W2 > wi > ws, there 
exists a solution of the KKT system in (ITtI ). {j3,6,R), with > and ii > such that this solution 
solves the KKT system in ( fT9l ) with (A, 7?, ^) = fi, a' = 9 and with identical rates i?. 

Proof: See Appendix IIVI ■ 
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Theorem 3 (wi > W3 > W2): Given Rq satisfying (fT4l) and a weight vector with wi > ws > W2, any 
locally optimal solution of (fTSl ) must have R2 = 0. Furthermore, for this weight ordering, the optimal 
solution of ( fTSl ) must have R2 = 0. 

Proof: See Appendix IVl ■ 

Corollary 1 (wi > > W2): Given Rq satisfying ([T4l ) and a weight vector with wi > W'^ > W2, 
there exists a solution of the KKT system in dTT] ). (/?, 0, i?), with Of = 82 = and = such that this 
solution solves the KKT system in ( fT9l ) with (A, r/, = P, a' = 9 and with identical rates R. 

Proof: First observe that with R2 = 0, the partitions 9f and can be set to zero without affecting 
the set of rates generated by (fTSl ). To prove this corollary, we consider the KKT conditions corresponding 
to (fTSl ) with of, 62 and R2 set to zero. Doing so, it is straightforward to show that one solution of the 
resulting KKT conditions has /3j = 0, i = 0, . . . , 4, 8, 9, 11. (In this case the KKT conditions do not 
involve (32,^5 and Piq.) The statement of the corollary follows from identifying (A,?/, ^) with (3, a' with 
9 and noting that (fTSl ) yields the same rates as (fTSl ). ■ 

Remark 2 (Other cases): 

• When > W2 > wi, the conditions in ( |19a| )- (|19c| ) yield: 

/Sg > /92 + ^5 + /36 > and P5 + Pio >Pi>0. 

Using these inequalities and the symmetry between receivers Y and W, a result analogous to the 
one in Theorem [1] can be derived mutatis mutandis. 

• When ws > wi > W2, the methodology used to arrive at Theorem [3] and Corollary [T] can be used 
to show that any locally optimal solution of ( fTSl) must have R2 = 0, and that such a solution solves 
the KKT system in (fT9l ). 

• When W2 > ws > wi, we show in Appendix I VI I that there is no solution of the system of equations 
in (ITtI ) that lies in the feasible set of ([T6l ). i.e., no solution that lies in Region2. Therefore, for this 
weight ordering the rates and partitions generated by solving (fTTl) (corresponding to (fTSl l) do not 
lie in the SPC region (cf. ([T3l)). and we do not need to study this case further. From the symmetry 
between receivers Y and W, one can see that for this weight ordering the SPC rates and partitions 
are generated by solving the KKT conditions corresponding to (fT6l ) in a way analogous to that used 
for Regioni when W2 > wi > w-i. See Remark [3l below. □ 

An observation regarding Theorems [l]-l3l Corollary [T] and Remark |2] is that for every weight ordering 
only one of the partitions a, a' or a" is used to yield a rate vector on the boundary of the SPC rate 
region. 
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VII. Tightness of the relaxation in (ITSl) 

In this section we show that for all relevant weight orderings, i.e., all orderings except W2 > > wi, 
the rate region generated by ( fTSl) is identical to that generated by ( fTSl ). To show that, we have the following 
result, which is based on a transformation of the problem in (fTSl) into a convex optimization problem. 

Theorem 4: The KKT conditions are necessary and sufficient optimality conditions for the problem 
in ([H. 

Proof: See Appendix IVIIll ■ 

Theorem |4] implies that for any Rq satisfying (fT4l) and any relevant weight vector, w, any solution of 
the KKT system in (fT9l) yields the maximum weighted sum-rate. This leads to 

Theorem 5: The rate region generated by solving ([TSl l for all relevant weight vectors, i.e., all orderings 
except W2 > > wi, is identical to that generated by solving (fTSl) . 

Proof: Recall that the solutions provided in Theorems [U [2l |3] and Corollary [T] solve both the KKT 
conditions corresponding to ( fTSl ) and those corresponding to ( fTSl ). Using Theorem |4l we conclude that 
these solutions are sufficient for the optimality of the weighted sum-rate generated in (fTSl ). Now, ([TSl l 
is a relaxation of ([TSl l. and hence the weighted sum-rate generated by ([TSl l is an upper bound on that 
generated by dTSl ). Since the solutions provided Theorems [H |2j [3] and Corollary [T] yield the identical rates 
for both ([TS] ) and ([TSl l. we conclude that these solutions yield the maximum weighted sum-rate in (fTSl) 
and hence the theorem. ■ 

So far we have shown that for any distinct weight settings, apart from the case in which W2 > W'i > 
wi, the optimization problems in ([TSl l and ([TSll are equivalent under the assumption that the power 
partitions are strictly greater than zero. This, however, is not restrictive, because the rate constraints are 
continuous functions of the power partitions. Hence, infinitesimal changes in the power partitions result 
in infinitesimal changes in the data rates. 

Using the symmetry between receivers Y and W, it follows that 

Theorem 6: For all relevant weight vectors, i.e., all orderings except W2 > wi > ws, the rate region 
generated by solving (fT6l ) is identical to that generated by solving the corresponding relaxation. 

Proof: The proof of this theorem follows a path analogous to that used to prove Theorem \5\ ■ 

Remark 3: For all weight orderings other than W2 > > wi, solving ([TSl l yields SPC achievable 
rates. When W2 > ws > wi, SPC achievable rates can be obtained by solving the corresponding relaxation 
of Region2. Alternatively, for all weight orderings other than W2 > wi > w-^ SPC achievable rates can be 
obtained by solving the corresponding relaxation of Region2, and when W2 > wi > w-^, SPC achievable 
rates can be obtained by solving (ITSl) . □ 
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Our goal now is to show that for any achievable rate vector R, there exists a power partition ^ G 5 such 
that {9,R) G RegioHj, i = 1,2. The equivalence between (fTSl) and (fTSl) implies that (for Regioni) it is 
sufficient to show that for any achievable rate vector R, there exists power partitions a, a', a" € 5, such 
that the constraints (1 1 8bl )- (l 1 8il) are satisfied. An analogous argument can be used to show that Region2 
contains all achievable partition-rate vectors. 



In this section we provide some information theoretic bounds on the achievable rates. These bounds 
will be used in Section |IX] to show that Regioni and Region2 contain all achievable rate vectors. 

Let Mo G {1, ... , 2"-^^°} denote the common message that is intended for all receivers, and let G 
{!,... ,2"^*=}, k = 1,2,3 denote the particular messages of receivers Y, Z and W, respectively; see 
Figure [T] Let the decoder of receiver Y be denoted by gi , where gi maps a length n block of the signal 
received by receiver Y to the set of receiver Y's messages; that is, gi : (Yi, Y2) ^ (Mq, Mi). An error 
event for receiver Y occurs if (Mo,Mi) / {Mq,Mi). The average probability of this event is denoted 
by Pg". In a similar manner, we define the decoders and the associated average error probabilities of 
receivers Z and W and denote them by and PJ^, respectively. A rate vector {Rq, Ri, R2, R3) is 
achievable if for every e > there exists a sequence of codes (indexed by n) such that for all sufficiently 
large n the probability of error P" < e, where Pg" = max{Pg'^^,PJ^,P^}. 

To obtain the desired information theoretic bounds on achievable rate vectors, let €j, i = 1, 2, 3 be a 
small positive number and let 



VIII. Information theoretic bounds on achievable rates 



Uf = [Mo, Ms, Z2,Y2], Vf = [Mo, Z2], A-f 

Ul = [Mo,M,,Zi,W,], Vl = [Mo,Zi], Xi 

Ul = [Ul,M2], Vl = [VlM2\, Xl 

Ul = \Ul,M2l V| = [V|,M2,Mi,yi], Xl 



V?, 
V|, 

[Xl,M2,M-i,W2\ 
[Xl,M2\. 



(21) 



In Appendix |K] we will use Fano's inequality to show that 



nRo < ml; Yi) + I{Ul; Y2) + nei 



(22a) 



n{Ro + Pi) < ml, Y2) + I{Xi;Yi) + nei, 



(22b) 



n{Ro + Ri+ R2) < I{Ul, Y2) + I{Ul, Z2\Ul) + I{Xi;Yi) + nei + nea, 



(22c) 



n{Ro + R1+R2 + P3) < I{Kt, Y2) + I{Ul, Z2\Ul) + /(X2; WslZ^I) 



+ /(Xi; Yi) + nei + ne2 + ne^ 



(22d) 
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ni?o < I{Ul ■,Wi)+I{Ul,W2)+ nes , (22e) 
n(i?o + ^3) < I{Uh Wi) + /(X2; 1^2) + nes, (22f) 
n(i?o + ^2 + i?3) < /(Z^i ; Wi) + I{Uh Zi\u!) + /(X2; 1^2) + nes + neg, (22g) 
n(i?o + i^i + i?2 + iis) < I{Kf] Wi) + ^^|2^3) + /(Xi; YilZ^f) 

+ /(X2;iy2) + nei + ne2 + ne3, (22h) 

where Xj is the symbol transmitted on subchannel i; of. Figure [U 
In Appendix |X] we show that 

nRo < liVf; Zi) + /(V|; Z2) + ?ie2, (23a) 

n{Ro + R2) < I{Vl, Zi) + /(V|; Z2) + ne2, (23b) 

n{Ro + Ri+ R2) < I{Xr,Yi\Vf) + /(Vf ; Zi) + /(V|; Z2) + nei + ne2, (23c) 
n{Ro + i?i + i?2 + i?3) < IiXr,Yi\v!) + /(X2; iy2|V|) + I{Vh Zi) 

+ /(V|;Z2) +nei +ne2 + ne3. (23d) 

In Appendix |X] we also show that 

ni?o < /('^'f ; ^1) + Z2) + ne2, (24a) 

n(i?o + i22) < Zi) + /(;f|; Z2) + ne2, (24b) 

n{Ro + R2 + R3) < I{X2\ W2\Xi) + I{Xf\ Zi) + /(;f|; Z2) + nei + ne2, (24c) 
n{Ro + R1 + R2 + Rs) < IiXi;Y^\Xl) + /(X2; W^2|^|) + ^(-^f ; ^1) 

+ /(Af|;Z2) + nei + ne2 + ?ie3. (24d) 

The inequalities in (I22al )- (l22dl ) and (1231 ) will be used to show that Regioni is an outer bound on the 
capacity region, whereas for Region2, we will use (I22al )- (l22dl ) and ((24l) . 

IX. The capacity region of the BC channel in Figure [H 

From Section IVIII we have that the rate regions generated by Regioni and Region2 are equivalent to 
those generated by their corresponding relaxations. Hence, to show the converse it suffices to show that 
the rate vectors contained in the intersection of these relaxations form an outer bound on the capacity 
region. That is, for every achievable rate vector there exist three independent sets of power partitions 
such that the inequalities in (I18bl )- (ll8il ). and those corresponding to Region2 are satisfied. In order to 
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do that we invoke the inequaUties in (l22l) and (1231 ) in the case in which the subchannels are Gaussian. 
Using (I22I) and (l24l ). an analogous argument can be used to show that Region2 is an outer bound on the 
capacity region. For Regioni we have 

Theorem 7: The rate region generated by ( fTSl ) is an outer bound on the achievable rate region. 
Proof: See Appendix IXj ■ 
For Region2 we have 

Theorem 8: The rate region generated by the corresponding relaxation of Region2 in ([T6l ) is an outer 
bound on the achievable rate region. 

Proof: The proof of this theorem parallels that of Theorem |7] but with a' defined as in Appendix IXIII 

■ 

We are now ready to present the main result of the paper. 

Theorem 9: The capacity region of the BC channel in Figure [T] is the closure of the region of rates 
achieved by superposition coding and Gaussian signalling, which is the closure of rate vectors contained 
in the SPC region defined in Q. 
Proof: 

• Achievability: By construction, for any given power allocation, all rate vectors satisfying Q are 
achievable by superposition coding and Gaussian signalling. 

• Converse: To prove that the SPC region contains all achievable rates, we observe that the SPC region 
in (O is equivalent to Region^^ QRegiong; cf. ([T3] ). From Theorem [5] and Theorem [6l we have that 
the rate vectors in Region^^ and Region2 are identical to those generated by the con^esponding 
relaxations. Now, from Theorem |7j we have that the rate region generated by (fTSl ) is an outer bound 
on the achievable rate region. Using a similar argument with Theorem [H we see that the rate vectors 
contained in Region2 also form an outer bound on the achievable rate region. Hence, the rate vectors 
contained in Region^ P| Regiong form an outer bound on the achievable rate region, which establishes 
the desired converse. 

■ 

X. Conclusion 

This paper considered the class of BC channels depicted in Figure [H wherein each receiver receives 
a particular message along with a common message that is intended to all receivers. It was shown that, 
for this scenario, every achievable rate vector can be attained by superposition coding and Gaussian 
signalling. Our approach to establishing this result is based on an ostensibly relaxed characterization of 
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the region of rates that can be achieved by superposition coding and Gaussian signaUing and on showing 
that this relaxation is tight. Although the focus of this work has been restricted to the scenario depicted 
in Figure \T\ we suspect that the same methodology can be applied to systems with alternate degradation 
orders and possibly with more receivers. 

Appendix I 

Analysis of the Lagrange multipliers in ( fT9l ) 

A. Proof of Lemma |2] 

In order to find Aq, we use the fact that /01(a), /012(a) and /0123(a) are not functions of a{, and 
hence from (|19dl ) we have 

0. (25) 



da{ Nl + {a\ +al)Pi 
Hence, for any Pi > 0, Aq = 0. For ryo, we apply the observation that go2(a'), 9oi2(a') and 50123(0') 

are not functions of to ( |19el l to write 

dL _ -r]oPi 

~ iV2 + (a'2 + a'/)Pi " °' ^ ^ 

which yields % = for any Pi > 0. Similarly, by differentiating the Lagrangian with respect to a'2, 

and using ( |19f| ). one can show that for any P2 > 0, ^0 = 0. 



B. Proof of Lemma \3\ 

In order to draw some insight into the relationship between these multipliers, we use ( |19d| ) and the 
defintions in Section Ull to write 

dL _ — (Aoi + A012 + Aoi23)-P2 — (A012 + Aoi23)-P2a2 A0123-P2 _ „ ,27-) 

da\~ iV| + {al + al)P2 (iV| + (a^ + al)P2){N^ + a^Ps) + a^P2 ~ ' 

dL _ — (Aoi + A012 + Aoi23)-P2 (A012 + Aoi23)-P2 _ „ 

Since, P2 > and Aoi,Aoi2 and A0123 are non-negative, ( [27] ) and (|28] ) are satisfied if and only if 

Aoi = A012 = A0123 = or 

A0123 > and Aoi > 0. (29) 



Furthermore, substituting from (1281 ) into (|27] ). we have 

A012 + A0123 A0123 



(30) 



Since N'^ > iVj, this impHes that 



unless Aoi = A012 = A0123 = 0. 



iV| + alP2 Nl + alP2 ■ 

A012 > 0, (31) 
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C. Proof of Lemma^ 
Using ( |19e| ) we have 



dL _ -(r/02 + r?012 + ??0123)-Pl (??012 + ??0123)-Pl _ ^ .^^s 



_ -(r/02 + ??012 + ??0123)-P2 _^ ^0123-P2 ^ q ^^2) 



Since Pi and P2 are strictly greater than zero, from (l32l) and (l33l) and the non-negativity of r?02, f?oi2 and 
r/0123, we have either 7?o2 = %12 = %123 = 0, or 

r?02 > and 770123 > 0. (34) 

D. Proof of Lemma \5\ 

Using the definitions in Section |lll we differentiate the Lagrangian with respect to a'/^ and a'/^. 
Substituting into ( |19f|) . we conclude that either ^02 = C023 = C0123 = 0, or 

^03 > 0, eo23 > and ^0123 > 0. (35) 

Appendix II 
Proof of Theorem [T] 

A. A solution of KKT system of equations ( |17l l for original problem dlSI l for wi > W2 > W3 

For wi > W2 > ws, (I17al )- (ll7cl ) yield 

Pi>p5 + Pio > 0, and /32 + /35 + /36 > /39 > 0. (36) 

From the first inequality in (|36l ). it is seen that /?i > 0. Using this fact in (|17el ). it is seen that /?2 + /33 > 0. 
For the moment, we will assume that /32 > and > and we will show later that this assumption is 
without loss of generality. 

In Appendix JII] we show that one solution of the KKT conditions can be obtained by setting 

Pi = 0, i = 0,i,...,U. (37) 

Using ( [37] ) we have wi = Pi + (^2 + P3, ^2 = (32 + Ps, and w^^ = P^. The complementarity slackness 
conditions for this choice of Lagrange multipliers yield 

Ro + Ri = foiiO), Ro + Ri + R2 = fouiO), and Rq + Ri + R2 + R3 = f 0123(0) ■ (38) 

We now show that because P2 + P3 > 0, we can assume that P2 > and P-^ > 0, without loss of 
generality. Towards that end, we observe that: 
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i. If /32 > and /33 = 0, then R2 is determined by the second equaUty in (138]) . Now, in this case, it may 
not be immediately clear that is determined by the last equality in (|38] ). Substituting from (I17el ) 
into dndl ) we have that /Jy > 0, which implies that i?o + ^1 + ^2 + ^3 = 50123(6*)- 
Now, suppose that R^, is not determined by the last equality in (|38] ). In that case we would have 



i?3 < i log^ ^^+^i^-^' j . Since Ro + Ri+R2 + R3 = gousiO), it would follow that i?o + ^1 + ^2 > 
fl'oi2(^)> which contradicts the middle inequality in (I17nl ). Hence, in this case R3 must be determined 
by the equalities in (|38] ). 

ii. If /32 = and > 0, then R2 + -R3 is determined by the third equality in (l38l ). Furthermore, 
from the last two terms in ( |17d| ) we have that /Js + /^e > 0. We will use contradiction to show that 

/35 = /36 = 0. 



Suppose that (3^ > 0. In that case, Rq + R2 = 502 (^)- From the middle inequality in (17ji, we 
have R2 < log ( '^j^^^gip^ ^ j > because f3i > leads to i?i being determined by the first equality 



in QB- Now, 

1, ^N^ + {el + e^)P2 



Ro > go2{e) - -iog(^- 



iv| + elP2 



1 ^ iVf + Pi ^ , 1, f iV| + P2 \ 1, /iV| + (01 + ^2)^2 



.log ..2 , .1 ^ + TT^og 



2 ''ViVf + ^iPiy 2 ^ViV| + (0| + 02)p2. 
>5o(^), 

which contradicts the middle inequality in (I171I ). Hence, we conclude that /^s = 0. 



Now, assume that /?6 > and consider the last two terms in (17gi. Since (3^ = 0, it is seen that 
/3io > 0. In that case the complementarity slackness condition in ( |17r| ) implies that i2o + ^2 + ^3 = 

ho23{0), but since /?i > and /Jg > 0, we have ii2 + ^3 = I log ( ^^Nfle^^" ) + ^ l°g ( ^"nT" ) - 
Hence, in this case we have 



1 f N^ + Pi ^ , 1, /Ai+jf^Wl, /iV^+(^|+^ 



1, /iV| + (0K ^2)^2 \ 1, /iVl+02^P2 



2 ""V iV| + 0iP2 / 2 Afi 
1 / iVf + Pi X 1 / iVi + P2 \ 1, /iVf + (0| + 0f)Pi 



2 '^VAr3^(0} + 02)p_^; 2 '^\N^ + elP2J 2 iv2 + ^ip^ 

1, ^Ni+jel + el)P2 
q + 9iP2 



2^°Sl iV2 + 0^P2 
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O^^Sl ATI , /)1 



2 "V iV2^ + 6'^P2 

2 I ATS + (^1 + 02)pJ^ 2 ^ I iVf + ^ 2 ^ I + (0i 

> /io(^), 



which violates the middle inequality in ( |17p[ ). Hence, we conclude that /Sq = 0, /?2 > 0, > 0, and 
that the rates Ri, R2 and are determined by (|38]) . 



B. A solution of KKT system of equations ( 1191 ) for relaxed problem 0181 ) for wi > W2 > w-^ 
Using ( |19a| ) and (|19b| ). we have 

Aoi > %2 + C023 > 0, (39) 

and from il9U and ( |19cl ) 

A012 + ??02 + 7?012 > $,03 > 0. (40) 

From (|39l ). we have Aqi > 0. Hence, from Lemma |3j we have 

A012 > and A0123 > 0. (41) 

Using ([T9hl )-([T9]]), we have 

Ro + Ri = foi (a) , Ro + Ri + R2 = fouici) and Rq + Ri + R2 + R3 = /0123 (a) ■ (42) 
Now, we set 

^02 = %12 = ''70123 = 702 = 7023 = 70123 = Co3 = Co23 = '^0123 = 0. (43) 

Using (l42l ) it can be seen that the setting in ( |43] ) solves the KKT system of equations in ([T9l ). for any 
a', and a" that satisfy the middle inequalities in (|19k| )- (|19r| ). 

C. Identifying solutions of ( fTTl ) ant/ ( fT9l ) /or wi > tt;2 > 'Ws 

For > ^2 > W3, we now compare the solution of the KKT system of the relaxed problem in 
the previous section with that of the KKT system of the original problem ([T5] ) in Appendix III- A I In 
particular, let 

Ao = Po, Aoi = Pi, Aoi2 = 02, Aoi23 = 03, (44) 
riQ = Pa, r]02 = P5, %12 = Pe, %123 = Pr, (45) 
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and 

^0 = Ps, ?02 = /?9, ^012 = PlO, '^0123 = Pll- (46) 

Since a solution of ([TT] ) exists with /?j = 0, i = 0,4, ... ,11, it is seen that for this solution ( |17d| ) 
and (I17eb become identical to (l27l) and (l28l) . respectively, when 

a = e. (47) 

Now, we choose a' and a" arbitrarily so that ( |19k| )-( fT9rl ) are satisfied. Such a' and a" exist because 
there exists a power partition 9 that satisfies ( [TT] ). Finally, it is seen that with a identified with 9, the rates 
generated by ((42)) are identical to those generated by (l38l) . which completes the proof of Theorem [T] 

Appendix III 

Proving that for wi > 11)2 > W3, A = 0, i = 0, 4, . . . , 11 

When wi > W2 > w^, we have /5i > 0, /32 > and /33 > 0; see Appendix III-AI First, let us assume 
that /3io + Pii > 0. We will use contradiction to show that /3io = /3ii = 0. 

For this weight ordering /3i > 0, /32 > and > 0, and hence the rates are determined by ( |17i| )-( fT7kl ). 
Therefore, from the last equality in (11711 ) we have 

Let us assume that (3iq and can be arbitrarily small but /3io > and /3ii > 0. In that case, 
using (|17r|) and ( |17sl ) we have, 



1 /A^K^JPi 



'1 



i?i = 2log(^^). (49) 



Substituting from ([491) into (|48]) yields 



2 ^\Nl + {9l + 9^)P2J 2 ATI ; 2 

1 f NI + P2 ^ , 1, / iVi^+Pi \ .... 
^ 2 ATS + (gi + el)P2 ) + 2 ATI + (gi + ) = m, 

which contradicts the middle constraint in (I17hl ). Hence, it is seen that the case of (5iq > and Pu > 
can be eliminated. 

A similar argument can be used to eliminate the possibility that either /3io or is greater than zero. If 
Pio = and > 0, then from ( 17g[ ), /?5 > 0. Using the complementarity slackness condition associated 



with (3^ and the fact that R2 is determined by the last equality in ( 17j 1, one can show that Rq violates 



the middle constraint in (11711 ). Hence, the possibility of /3io = and Pu > can also be eliminated. 
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Now, let us consider the possibility that Piq > and Pn = 0. In this case, we can assume that 
i?i < i log ( ^ ^ j . Using this expression in the first equality in (1381 ) yields an Rq that violates the 
middle inequality in (I17hl ). Hence, the possibility that (3iq > and /5ii = can be eliminated. 

In the argument above we have shown that (3iq + /3u = 0. Since the last term on the left hand side 
of (llVfl ) is the only non-negative term, we conclude that Po = = Ps = Pg = 0. Substituting Pi = 



for i = 0, 4, 8, 9, 10, 11 into ( |17g[ ) we have, 

Pe + P7 P5 + P6 + P7 



(50) 



Now, we will use contradiction to show that /?5 = 0. To do that, we note that if /Js > then from the 
last equality in (117ml ) 

However, because P2 > we have 

Substituting from ( [52] ) into dSTT ) and simplifying yields 

which violates ( 11711 ) for any 6*1 > 0. Hence, we must have P^ = which, using dSOl ) and the fact that 
Nf > Nj, leads to Pe = Pr = 0. We have thus shown that when wi > W2 > w^, Pi = 0, i = 0, 4, . . . , 11, 
as desired. 

Appendix IV 
Proof of Theorem [2] 

A. A solution of KKT system of equations (1171 ) for original problem (115b for W2 > wi > 

For W2 > wi > W3, (I17al )- (ll7cl ) yield 

P5 + Pio>Pi>0 and P2 + P5 + P6> P9>0. (54) 

In Appendix JII] we showed that if /?i > then P^ = Piq = 0, which contradicts the first inequality in ( [54] ). 
Hence, it is seen that in this case /?i = 0. A similar argument can be used to show that Pg = 0. We will 
show below that a solution of the KKT conditions in this case can be obtained by setting P2 = P3 = 0. 

For /?2 + /33 = we have from ( |17e| ) that Po = P4 = Ps = 0. Applying this fact and the fact that 
/39 = to ([HB yields pio = pn = 0. Using 

Pi = 0, f = 0,...,4,8,...,11, (55) 
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in (O, (ll7dl)-([T7gl) and (llVaMlVcb with the current weight ordering yields /?5 > 0, /?6 > and f3j > 0, 



from which we have 

Ro + R2 = 902(0), Ro + Ri + R2 = 9012(0), and Rq + Ri + R2 + R3 = 90123(0)- (56) 



It remains to show that the rates generated in (1561 ) are feasible, i.e., that setting (32 = = yields 
a solution of the KKT system of equations. Suppose that (32 + > 0, then from ( |17e| ) we have that at 
least one {/3j}j=o,4,8 is greater than zero. Using this fact in ( |17f| ) yields (3io + (3u > 0. Now, suppose 
that (3^ + (3q + (3^ = 0. (This assumption results in fewer constraints being active.) In this case, we have 
P2 > 0, /33 > 0, (3io > and (3ii > 0. The complementarity slackness now implies that at least one of 
the constraints on Rq is active, and for each rate k = 1,2, 3, one can find two expressions. Equating 
these expressions, it is seen that in this case we have four equations in the four unknowns, {0f}i/=i^2- 
Solving for these unknowns and substituting into (|17d|)-([T7g]) we have four equations in five unknowns, 



P2, (33, (3io, (3ii and one of {/3i}i=o,4,8> in addition to the three equations (I17al )- (ll7cl ). That is, in total we 
have seven linearly independent linear equations in five unknowns. Since these equations cannot be 
consistent we conclude that one must have /32 + /?3 = for the problem to be feasible. 

B. A solution of KKT system of equations ( 1191 ) for relaxed problem (1181 ) for W2 > wi > 
For this weight ordering, the KKT conditions of the relaxed problem yield 

r]02 + C023 > Aoi > 0, and A012 + ??02 + ?7oi2 > Cos > 0. (57) 

Now, set 

Aoi = A012 = A0123 = '^03 = C023 = '^0123 = 0. (58) 
Using this setting in ( |19a| )-( fT9cl ). along with Lemma |4] and the fact that W2 > wi > w^, we have that 

Ro + R2 = 9o2(a'), Ro + Ri + R2 = 9012(a), Rq + Ri + R2 + R3 = 90123(0')- (59) 
Now, a and a" can be arbitrarily chosen so that ( |19h| )-( [T9]] ) and ( |19p[ )- (|19r| ) are satisfied, respectively. 

C. Identifying solutions of (1171 ) and ( 1191 ) for W2 > wi > W3 

For W2 > wi > w^, we now compare the solution of the KKT system of the relaxed problem obtained 
in the previous section with that of the KKT system of the original problem in ([TS] ). Since a solution 
of (fTTl ) exists with = 0, i = 0, . . . , 4, 8, . . . , 11, it is seen that for this solution (I17dl) and (I17el) become 
identical to ( |27l ) and ( |28] ). respectively, when 

a' = e. (60) 



November 3, 2009 



DRAFT 



26 



Now, we choose a and a" arbitrarily so that ( |19k| )-( fT9rl ) are satisfied. Such a and a" exist because there 
exists a power partition 6 that satisfies (fTTl ). Finally, it is seen that with a' identified with 9, the rates 
generated by (l42l) are identical to those generated by ( [38l) . which completes the proof of Theorem |2l 

Appendix V 
Proof of Theorem [3] 

We proceed by contradiction. In particular, we assume all the rates and partitions to be strictly positive 
and show that this leads to the desired contradiction, and that this contradiction is resolved by setting 
i?2 to zero. 

A. Original problem with wi > ws > W2 

In this section we show that, given Rq satisfying (fT4l) and a weight vector with wi > > W2, any 
locally optimal solution of dTS] ) must have R2 = 0. First, assume that > 0, for k = 1,2,3. We will 
show in this section that for this weight setting this assumption leads to a contradiction. 

We begin by noting that under the assumption that R^ > 0, we have from ( |17a| )-( fT7cl ) that 

Pi>p5 + Pio > 0, and ^9>P2 + p5 + ^6> 0. (61) 

We will now show that Pi and (3g cannot be strictly greater than zero simultaneously, and we will use 
this to conclude that R2 = 0. Since /3i > 0, we have from (I17el ) that (32 + P3 > 0. Similarly, because 
Pg > 0, we have from ( |17fb that Piq + Pn > 0. Also, since Pi > 0, we have that 

Ro + Ri = foi{9), and since pg > 0, (62) 
Ro + R3 = ho3ie). (63) 



1) Showing that P3 = Pu = 0: Suppose that Pu > 0. In this case, using (1631) and the last equality 
in (I17sl) . we have 

2 ATI ; 2 N^ + elPi J 



From (162] ) and (164] ). we have 

Ro> Ro + Ri- {Ri + R2) (65) 

= Rq — R2 

1 . (Nl + Pi\ 1 ( NI + P2 
- log — — + - log' 



2 Nl J 2 ^\Nl + {9l+el)B^ 
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log - o log 



2 ATI ; 2 Ar2 + 0ip^ 

>olog ..1 +olog' 



2 ATI ; 2 ^Va^| + (01 + ^2)^2 

_ 1 /iV^+^x (Nl±iOl±m.) 

= 2 ^°4ivFTWTW)A ) + 2 HNi + iel + 9l)pJ ' ^''^ 

which contradicts ( |17h| ). Hence we conclude that Pn = 0. Notice that the contradiction here is resolved 
if P2 = and Of = 0. Using a similar argument, we conclude that = 0. The contradiction for the 
latter case is resolved if i?2 = and = 0. 

2) Showing that P2 = = O; In order to show that cannot be strictly greater than zero for all 
k = 1,2,3, we have to show that ^2 = (or alternatively that /?io = 0). This will contradict (I17el ) for 
/3i > 0. 



If (32 > 0, then from the last equality in ( 17j I we have 

Ro + Ri + R2 = /oi2(^)- 

Using this in the middle inequality in (llVkl ). we have -R3 < i logf^^^i^y Using that in ^ yields. 



1, / N? + Pi \ 1 
^°-2^°4 Ar3 + (gi + g2)pJ + 2l°g 



N^+P2\ 1, /iVj+0|P2 



_1 / Nf + Pi X 1 / N^ + P2 

2 A^f + + 02)p^ ; + 2 V A^i + elP2 

This inequality contradicts ( |17p| ) for any ^3 > 0, and the contradiction is resolved if 0| = 0. The argument 
that /3io = can be made analogously, and the contradiction in that case is resolved if Of = 0. 



B. Relaxed problem with wi > W3 > W2 

In this section we show that for wi > W3 > W2, the optimal solution of (fTSl) must have R2 = 0. To 
show this, we will assume that Rk > 0, for k = 1,2,3, and then proceed by contradiction. If Rk > 0, 
for = 1, 2, 3, then from ( |19a| ) and ( |19c| ) we have that 

Aoi + A012 + ??oi2 > Cos + C023 > 0, (67) 
and from ( |19b| ) and ( |19c| ). we have that 

Cos > V02 + mi2 + A012 > 0, (68) 
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from which we have 

Aoi > r/02 + (o23 > 0. (69) 



Now, using dM) and we have from dig, dlD, (fT9hl)-([T9]]) and ([T9pl)-(fT9rb that 



and 



We will now show that R2 = and that a'/^ = a| = 0. Consider the value of the objective that 
corresponds to the equalities in dVOl) . namely 



2 ATI J 2 ''\Ni + {al + al)P2J J 2 + a^Ps 

+ "^2^°4 ATI )• ^'^^ 

Observe that, for a given Rq, the value of the objective does not depend on the partitions a\ and af 
Consider now the value of the objective that corresponds to power partitions 7^=02 + ^^'^ 72 ~ 
In this case the value of the objective is given by 

"<2^°<^V^) + 2^°H iV3 + (,i+^2)pJ -^oJ +-3 2log( ^1 ). (73) 

Subtracting (1721 ) from d73l) . we have 

^3nlog ip -U-s-log ,,2^ Ip >0 

2 V iVg + 02 "2 ^ 2 V iVg + 02^2 ^ 
where the inequality follows from the fact that N2 > N2 and W2 < w^. Hence, it is seen that, for this 
weight ordering, the rates yielded by dTOl) are not optimal unless P2 = and a| = 0. Using a similar 
argument, we can show that the rates yielded by dTTl) are not optimal unless i?2 = and a"^ = 0. 
Observe that the rates yielded by setting R2 = and a'p = 0^ = are feasible because these rates are 
feasible for the restricted case of a = a"; see Appendix IV-AI 

Appendix VI 

The case of w2 > > wi 

In this section we show that in the case of W2 > W3 > wi the rates and partitions generated by solving 
the KKT system in (fTTl) corresponding to (fTSl ) does not belong to the feasible set of ([T6b . and hence does 
not belong to the intersection of the two regions, which is the SPC region of interest. For this ordering. 
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because of the symmetry between the degradation order of receivers Y and W (cf. Figure [T]), feasible 
rates and partitions can be generated by solving the KKT system corresponding to the description of 
Region2 in (fT6l ) in way similar to the one used to generate feasible rates and partitions for W2 > wi > w-^ 
from the KKT system corresponding to the description of Regioni in (fTSl) . 

We now analyze the KKT conditions for this particular ordering. Using W2 > > wi in ( |19a| )-( [T9cl ). 
we have 

P2 + P5 + P6> P9>0 and (39 + Pw>Pi>0, (74) 

from which we have 

P5 + Pio > /3i > 0. (75) 

As argued in Appendix |IVJ if /3i > then fS^ = /3io = 0, which contradicts the second inequality in dTSl ). 
Similarly, if /Jg > then P2 = = = 0, which contradicts the first inequality in (IT?] ). Hence, we 
conclude that Pi = f3g = 0. Since I3g = 0, we have from the second inequality in (1741 ) that 

Pw > 0. (76) 

Using the first inequality in (1741 ) in (I17dl ) yields 

P3 + P7> 0. (77) 



Using (1761 ) in ( 17gi yields 

P6 + P7 + Pii > 0. (78) 

We now consider all possible assumptions for P^, Pq and Pj: 

. [Pb + pQ + Pi = 0], [P5 >0,Pe> 0,P7 > 0], [Pr = 0, P5 > O^Pe > 0] and [Pe + Pj = 0, P5 > 0]: 
These assumptions can be ehminated by using an argument similar to the one in Appendix IIV-AI 
to show that they result in a number of independent linear equations that exceeds the number of 
unknowns; 

• [P5 + /Se = 0, /?7 > 0]: For this assumption, the first inequality in (1741) yields P2 > 0. If R3 < 
^logl ^Tfi^ ^ I, which is possible because we have no conditions on P^, the fact that Pf > 



implies that Rq + Ri + R2 > gouiO), which violates (I17n! ). Now, if Rs = | log( ^"tfi'^M , we 



2 """6 \^ 

will have a number of independent equations that exceeds the number of unknowns. Hence, this 
assumption can be eliminated; 

[P5 + Pr = 0, Pq > 0]: This assumption yields Ps > 0. If i?3 < ^ log^^^^^^^, which is possible 
because under this assumption P^ = 0, the fact that P3 > implies that Rq + Ri + R2 > /oi2(^)> 
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which violates ( |17j[ ). Now, if i?3 = ^ log ( ^^i^ ^ j , we will have a number of independent linear 
equations that exceeds the number of unknowns. Hence, this assumption can be eliminated; 
[/?5 = 0, p6 > 0,(37 > 0]: For this assumption, R3 = i logf and Rq + Ri + R2 = 



5oi2(^)- If ^1 < ^ log y j , we have Ro + R2 > go2{G), which violates (117ml ). and if Ri = 

MogI ^ ,.1^ ^ , the number of independent Unear equations exceeds the number of unknowns. 



2 V N. 

1 P \ 

Hence, this assumption can be eliminated; 
• [/?6 = 0, /35 > 0, /37 > 0]: For this assumption we have 

fio + ^2 = 9o2W, and (79) 

i20 + i?l + ii2 + ii3 =50123 (^). (80) 

Now, if i?i = i log ( ^ ^ j , one can see that the number of independent linear equations 
exceeds the number of unknowns. Hence, we have Ri<l log( ^'j^^/^^ ) . Using this in & yields 
R3> I log( ^''^f That, together with implies that iio + -^2 + ^3 > 9o2z{G)- This implies, 
in turn, that this solution, although feasible for (fTSl ). is not feasible for (fT6l ) and hence is not in the 
SPC region, which establishes the desired result. 

Appendix VH 
a convex transformation of (itsl) 

In this section we will transform the relaxed problem in (fTSl) into a convex form. In particular, we will 
show that this problem can be a cast as a geometric program. We will assume that the powers Pi and 
P2 are given. However, the methodology that we use can be extended to the case in which the powers 
are not fixed a priori. In order to perform the required transformation, we use the following change of 
variables 

tk = e^^\ k = 0,...,3 (81) 

Qi=aip,, Q?=c/ip., Qf=«r^^- 

Now, using the monotonicity of the log function, the optimization problem in ( fTSl) can be cast as 



max tft^^tf (82a) 
subject to 

to{Nl + Q\ + Ql){Nl + Ql + Ql){Pi + Nlr\P2 + A^|)"' < 1, (82b) 

NltotiiNl + Ql + Ql){Pi + Nl)-\P2 + iV|)-i < 1, (82c) 
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NitotMNi + Ql + Ql){Nl + Ql){Pi + Nl)~\P2 + nI)-\nI + Q\ + QI)'^ < 1, (82d) 

N^^Nltoht2h{Nl + Ql + Q2)(iv| + Ql)iP, + iVi)~^(P2 + N^y^N^ + Q^)-^(iV| + QI + QI)-^ < 1, 

(82e) 

to(iVf + Q'/ + Q?){Pi + N^r\Nl + + Q2)iP2 + N^r' < 1, (82f) 
tot2(A^i' + Q'/)(A^| + Q'i){Pi + ^lr\P2 + iV|)"' < 1, (82g) 
A^itoiii2(A^f + Qi){Pi + A2)-1(P2 + A2)"i(iV| + Q'2^)(iVi^ + Q'/)"^ < 1, (82h) 
NlNlt^t^t2h{Nl + Q'l){N^ + Q',}){Nl + Q'/)-HiV2' + Q2r\P2 + N^rHPi + Nfy' < 1, 

(82i) 

to(iVf + Q'C + Qf )(Pi + Nf)-\N^ + Q'^ + Q'^m + N^r' < 1, (82j) 
N^totsiNf + + Qf )(Pi + Nfy\P2 + iVj)"' < 1, (82k) 
N^tot2h{Nf + Qf + )(7Vi2 + ^ Nf)-\P2 + N^rHNf + + Qf < 1, (821) 

N^Nltotit2t3{Nf + + gf )(iVf + )(Pi + iVf )-i(P2 + N^rHNl + 

X (TVf + Qf + Qf < 1, (82m) 



^QB^^, ^ = 1,2, (82n) 

2 

J^Qf<^'i, i = l,2, (82o) 

2 

^Qf<P*, i = l,2, (82p) 

Q\ > 0, Qf > 0, Qf > 0, i = 1, 2, ^ = 1, 2, 3, (82q) 
Let 

Tl = Ql + Nl/2, Tl = Ql + Nl/2, 

T^^=Q\ + Nl Ti = Q\ + Ql + Nl 

Ti = Q'l + iVf , T'^ = Q'l + Nl - Nl, 

T^i = Q'2^ + Nl ^ Q,2 ^ ^2 _ ^1^ 

Ti'' = Q'l^ + Nl Tf = + Qf + Nl 

Tf = Q'^ + N^/2, and Tf = Qf + iVjA 
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Hence, 



Q\ -- 


=n- 


Nl/2, 


Ql -- 


= rf - 


Nl/2, 


(83a) 


- 

Q2 - 






rP- - 


= -^2 - 


-t 2 + ^^2 ~ ^^2 ) 


{OJU) 


Q? 


= - 


-Nf, 


Q'l 


= - 


-{Nl-Nl), 


(83c) 


Q'i 


rpll 

— ^2 ~ 


-Nl 


Q'i 


rp/2 

— ^2 ~ 




(83d) 


Qf 


= Tf 


-Nl 




= Tp 


-T['^ + Nl-Nf, 


(83e) 




— ^2 


- Nl/2, 


and 


rpll2 

— ^2 


- 


(83f) 



Using these new variables, we can re-write (I82nl ) as 

2 

<Pi + Nl , r| < P2 + Nl . (84) 

£=1 

The constraints in (l82ol ) can be re-written as 

^ ^/2 < p. + 2iV2 _ ^ ^ 1^ 2, (85) 

and the constraints in ( |82p[ ) can be re-written as 

2 

Tf^ < Pi + iVf , T'i^ <P2 + N^. (86) 

We now consider the conditions in ( |82q| ). First we note that by replacing the equalities in (I82nl )-( [82p] ) 
by the inequalities in (I84l)-(l86l). Qf, Qf, and Q"^ are eliminated from the formulation. (These variables 
do not appear in any other constraint.) For the first set of constraints in ( |82q[ ), we have 

tI>nI/2, tI>nI/2, T^>nI, and r| > + iV| - iVj . (87) 

For the second set, we have 

Tl^>Nl and T'^ > - N}, i = l,2. (88) 

For the last set, we have 

T'^^>Nl, Tl"^ >Tl^ + Nl - Nl, and T!{'^>NI/2. (89) 

Before proceeding to show how the remaining constraints can be cast as a geometric program, we recall 
that the degradedness condition A^f^^ > N^, for = 1, 2. Hence, one can see that all the transformed 
constraints in (I84l)-(l89l) are in the form of posynomials that can be readily incorporated in a (convex) 
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geometric program. Using the transformation in ([83] ). we can write the constraints in (I82bb - (l82el) as 
follows: 

to{Tl + Tf){Nl - Ni + T|)(Pi + Nly\P2 + iV|)-i < 1, (90a) 
Nltot^iNl - TVl + r|)(Pi + Nlr\P2 + iV|)-i < 1, (90b) 
NltotMNl - iV| + T|)(Ar| - + T^){Pi + nI)-\P2 + nI)~^ < r|, (90c) 
N^Nltotit2t3{Nl - Nl + T|)(7V| - + tI){P^ + Nlr\P2 + nI)'^ < T^T^. (90d) 

Note that because — A'^^ > 0, all the constraints in ( |90a| )- (|90d| ) are in the standard posynomial form. 

Consider now the constraints in ( |82f| )-( [82il) . Using the transformations in ( [83l ). these constraints can be 
written as 

to(Tf + )(Pi + iV2)-i(r^i + Ti'){P2 + iV|)-^ < 1, (91a) 

tot2{Nl - Nl + )(iV| - Nl + T^^)(Pi + iV2)-i(P2 + iV|)-^ < 1, (91b) 

A^i'iotii2(iVi - Nl + + Nlr\P2 + N^Y^N^ - + U}) < T[\ (91c) 

NlNltQtit2h{Nl - Nl + T[^){N^ - Nl + T!^){Pi + iVf )"^P2 + iV|)"^ < T^^. (91d) 

One can also see that (I91al )- (l91dl) are in the form of posynomial constraints. Finally, we express the 
constraints in (|82j[)-(l82ml) as 



to(iVf - Nl + Tf2)(rf + + Nly^{P2 + Nl)-^ < 1, (92a) 

NlhHNl - Nl + Tf2)(Pi + iV3)-i(P2 + iV2^)~^ < 1, (92b) 
NltQt2h{Nl - Nl + ri"2)(iV2 - iV^ + Tf + iVf )~HP2 + Nly^ < Ti'^, (92c) 
A^2 A^i^ioiii2t3(A^f - iVf + ri"2)(Ar2 - Nl + )(Pi + iVi^)-^P2 + iV2)"^ < T['^T['^ (92d) 
Seeing as ( |92a| )-( [92dl ) are in the form of posynomial constraints, we can now write (l82l) as 

max tl'H^H^' (93a) 

(93b) 
(93c) 
(93d) 
(93e) 



(|90a|l 


-(|90d|) 


(|91a|l 


-<|91d|) 


(|92a|l 


-(|92d|) 


dH- 
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Since the objective is in the form of a monomial and all the constraints are in the form of posynomials, 
the problem in ( [93] ) is readily seen to be a geometric program. 

We now transform this geometric program into a convex form. In order to do that, we take the logarithm 
of the objective and the constraints in ( |93] ). and we use the transformations 

X^ = log{T!), Xf = log{Tf), and Xf = log(i;"^), i = l,2, £=1,2. (94) 

We will also use (ISTI ) to write log(tfc) = 2Rk, A: = 0, ... ,3. Using these transformations, the problem 
in ( |93] ) can be written as 



3 

max 

k=l 



^ WkRk (95a) 



subject to 2i?o < log( ^4^^^. j +^»g( jv3_ jv2 + e^| j (95b) 
Ilk + < log(^^) + log( ^3 ^ ) (950 



2Ro + 2i?, + 2i?2 + 2i?3 < log(^^) + l°g( ^3_V|^,x| 

2i?o < log( + logf ^!^% ) (95f) 



/ iV? + Pi \ / N^ + P2 \ 



+ log(^^)+log(ii-) (95i) 



2R, + 2i?3 < log( ^3_;vf+W0 + ^^H^ivT^ ) ^^^^^ 



2 
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2Ro + 2R2 + 2R3 < log( , ' I + log^ 2 2 



AfS _|_ p \ / /\ri _|_ p 



iV3 _ Ar2 + gXrV ^-^V ATI 

2 

X] < ^1 + ^1^ ' < -P2 + A^l , (95n) 

f=i 

+ e^'" < Pi + 27V2 _ ^1 ^ i = 1, 2, (95o) 
2 

e^" < Pi + iVf , X] - ^2 + , (95p) 

e^' > Nl/2, e^i > nI/2, e^'^ > iV2^ > e^'' + ^2 - (95q) 

e^»" > iVf, e^'" > iVf _ ^1^ ^ ^ 1^ 2, (95r) 
e^"' > 7Vi\ e^"' > e^"' + TVf - nI, e^^" > N^/2, £=1,2. (95s) 



Note that this problem is identical to (1181 ). but with the power partitions parameterized by the exponential 
function. 

Appendix VIII 
Proof of Theorem H] 

First, we note that for any Pi and P2 greater than zero, the problem in ( fTSl ) is strictly feasible. From 
Section |Vl] it is seen that for each weight ordering, the active constraints at the provided solutions are 
linearly independent. (For each weight ordering, each constraint that is active at the provided solution 
involves a distinct partial sum of {Rk}k=v^ Hence, using Proposition 3.3.1 in [27], it is seen that the 
KKT conditions are necessary for optimality. We now show that these conditions are also sufficient. In 
order to do that, we use [27, Proposition 5.1.5]. Let L{A, 7) denote the Lagrangian function at the vector 
of primal variables. A, and the Lagrange multipliers, 7. Then, from [27, Proposition 5.1.5] it is seen 
that it is sufficient to show that, for any vector 7 > 0, if the vector A* = {R^, R2, R^,a* ,a'* ,a"*) 
satisfies V _aL{A,^)\_a=A' = 0, then it maximizes L(^, 7) for all feasible vectors A. In order to show 
this, we recall that in Appendix I VIII we showed that ( [T8l ) can be transformed into the convex form in (1951 ). 
Let Lc be the Lagrangian function that corresponds to this convex problem, and let B be the vector of 



November 3, 2009 



DRAFT 



36 



transformed variables in ( [94l ). Now, 



V^L(A7) = JVbLc(S,7), 



(96) 



where J is the Jacobian matrix of the transformation in ( [941 ). i.e., the ij-th entry of J is given by 
First we notice that this transformation is continuous, one-to-one and invertible. Now, one can easily 
check that 


Ji 



J 



where I3 is the 3x3 identity matrix, and 



J2 



J2 



Pi 

NI/2+Piai 







Pi 

N't+Pia{^ 







Pi 

Nl+Pia'{^ 
Pi 



Pi 

NI/2+Piai 






J3 





P2 

m+P2al 








N^+P2a'2+P20i^2 Ni+P2a'2+P2ai 



Pi 

N'i~Nl+Pia'i' 






Pi 







P2 

Ni+P2a'i 





N-t+Pia'l^+Pia'{' N't+Pia'{^+Pia'{' 










P2 



NU2+P2a'i 










P2 







P2 



(97) 



It is clear from (|97l ) that for any ^ > 0, the matrix J is non-singular. Together with ( |96l ) this implies 
that V^L(^, 7) = if and only if VLc(i3, 7) = 0. The convexity of the problem in (l82l ) implies that 
VbLc{B, 7) = only at the global maximum of Lc{B, 7). Hence, from the continuity and the one-to-one 
correspondence of the transformation in (|94l ). one can see that V_/[L{A, 7) equals zero only at the global 
maximum of L(^, 7), for any given vector 7 > 0, and hence for the optimal Lagrange multipliers 7*. 
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Appendix IX 
Proof of the inequalities in (l22l ) 

Given some small positive reals ej, j = 1,2,3, for every achievable rate, there is a sufficiently large 
n such that Pg" < ej. It follows from Fano's inequality that 

H{Mo,Mi\YuY2)<neu (98a) 

H{Mo,M2\Zi,Z2) < nes, (98b) 

H{Mo,M3\Wi,W2) < nes . (98c) 

In order obtain (I22al ). we have from Fano's inequality that 

nRo = H{Mo) < /(Mo; ¥,,¥2) + nei 

<I{Mo;¥2)+I{Mo;Y^\¥2) + nei 

< I{Mo;¥2) + /(Mo, ¥2, Z2; ¥1) + nei 

< /(Mo, Ml, Zi, Wi; ¥2) + I{Mo,M3, Z2, ¥2; ¥^) + nei 

= I{Uh ¥1) + /(^/|; Fa) + nei, (99) 

where Z/^i and ^1 defined in (|2TI ). Due to the symmetry between receivers ¥ and W, (I22el ) can be 
proved in a similar manner. 

We now show how to obtain the bound in ( |22b| ). Using Fano's inequality, we have 

niRo + Ri) <I{Mo,Mi;¥i,¥2) + nei 

= /(Mo, Mi;¥2)+ /(Mo, Mi;¥i\¥2) + nei 

< /(Mo , Ml ; y2 ) + /(Mo , Ml , ^2 ; 11) + nei 

< /(Mo, Ml, W^i, Zr,¥2) + IiUh¥i) + nei 

< /(^(|;y2) +/(^i;li) +nei. (100) 



Invoking the symmetry between receivers ¥ and W, one can prove (|22fl) in a similar fashion. 
In order to obtain the bound in (I22cl ). we write 

n{Ro + Ri + R2)< I{Mo,Mi;¥i,¥2) + /(M2; Zi, Z2) + nei + ne2 

< /(Mo, Mi; n, ^2) + /(M2; Zi, Z2IM0, Ml) + nei + nea 

< /(Mo, Mi; ^2) + /(Mo, Mi; yi|y2) 
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+ /(Ma; Zi,Wi\Mo, Mi) + /(Ms; Z2IM0, Mi, Zi, W^i) + nei + nea- 
By adding and subtracting the term I{Zi, Wi; Y2\Mq, Mi) in the above expression, we obtain 

n{Ro + /?! + R2) </(Mo, Ml, Zi, VFi; Fa) + /(Mq, Mi; ^1^2) + /(M2; Zi, VFi|Mo, Mi) 

+ /(M2; Z2IM0, Ml, Zi, T^i) - I{Zi,Wi;Y2\Mo, Mi) + nei + nea- (101) 
Further bounding of the right hand side yields 

n{Ro + Ri + R2) < I(Ul; Y2) + I{Ul, ZajZ^I) + /(Mq, Mi, Yz; Yi) 
+ /(M2; Zi, W^ilMo, Ml, ^2) + nei + ne2 
< I{Ul; Y2) + I{Ul, Z2\Ul) + I{Xi-Yi) + nei + ne2. 



In a similar manner, one can prove the bound in (22g 



In order to bound the sum rate in ( |22d| ). we have 

n(/?o + R1 + R2 + R3) 

< /(Mo, Mi; Yi, ^2) + /(M2; Zi, Z2) + /(A/3; 1^1, W2) + nei + ne2 + neg 

< /(Mo, Mi; y2) + /(Mo, Mi; yi|y2) + /(M2; 1^1, Zi) + /(M2; Z2\Wi, Zi) 
+ /(M3; VFi, Zi) + /(Ms; W2IVF1, Zi) + nei + ne2 + neg 

< /(Mo, Mi; y2) + /(Mo, Mi; yi|y2) + /(M2; T^i, Zi|Mo, Mi) 
+ /(M2; Z2IM0, Ml, T^i, Zi) + /(M3; 1^1, ZilMo, Ml, M2) 
+ /(M3; W2IVF1, Zi, Mo, Ml, M2) + nei + ne2 + neg 

= /(Mo, Mi; y2) + /(Mo, Mi; yi|y2) + /(M2, M3; Zi, Wi |Mo, Mi) 
+ /(M2; Z2IM0, Ml, M^i, Zi) + /(M3; W2\Wi, Zi, Mo, Ml, M2) 
+ /(H^i , Zi ; y2 1 Mo , Ml ) - /( VFi , Zi ; y2 1 Mo , Ml ) + nei + ne2 + neg 

< /(Mo, Ml, W^i, Zi; y2) + /(Mo, Mi; yi|y2) 

+ /(M2, Ms; Zi, VFilMo, Ml, y2) + /(M2; Z2IM0, Mi, W^i, Zi) 
+ /(Ms; W2IVF1, Zi, Mo, M2) + nei + ne2 + nes 

< I{Ui; Y2) + I{Ul, Z2\Ul) + /(X2; 1^2|Z^|) + I{Xi;Yi) + nei + ne2 + neg. 
One can use the same technique to obtain the bound in (I22hl ). 
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Appendix X 
Proof of the inequalities in (l23]i and (l24l ) 

Inequality (I23al ) for Regioni and inequality (I24al ) for Region2 are identical, and in order to prove them, 
we have 

nRo < I{Mo;Zi,Z2) +ne2 

= /(Mo; Zi) + /(Mo; Z2IZ1) + nea 
< /(Mo, Z2; Zi) + /(A/o, Zi; Z2) + ne2 

= I{Vh Zi) + /(V|; Z2) + ne2 = I{Xh Zi) + /(^|; ^2) + ne2. 
We now prove (I23bl ). Using Fano's inequality, we write 

n{Ro + R2) < /(Mo, M2; Zi, Z2) + ne2 

= /(Mo, M2; Zi\Z2) + /(Mo, M2; Z2) + ne2 

< /(Mo, M2, Z2; Zi) + /(Mo, M2, Ml, n; Z2) + ne2 
= /(V?;Zi)+/(V|;Z2)+?ie2. 

Similarly, to prove (I24bl ) we have 

n(/?o + /22) < /(Mo, M2; Zi, Z2) + ne2 

= /(Mo, M2; Zi) + /(Mo, M2; Z2IZ1) + n€2 

< I{Mo, M2, M3, W2; Zi) + /(Mo, M2, Zi; Z2) + ne2 
= /(A'f;Zi)+/(A'|;Z2)+ne2. 

We now prove (I23cl ). Using Fano's inequality we write 

n(/i:o + /?! + R2) < /(Mo, M2; Zi, Z2) + /(Mi; n, ^2) + r^ei + ne2 

< I (Mo, M2; Zi, Z2) + /(Mi; n, y2|Mo, M2) + nei + nes (102) 

< /(Mo , M2 ; Zi , Z2 ) + /(Ml ; n , Z2 1 Mo , M2 ) + nei + ne2 ( 1 03) 
= /(Mo, M2; Z1IZ2) + /(Mo, M2; Z2) + /(Mi; Z2IM0, M2) 

+ I{Mi;Yi\Z2, Mo, M2) + nei + ne2 

< /(Mo, M2, Z2; Zi) + /(Mo, M2, Mi; Z2) + /(Mi; yi|Z2, Mo, M2) + nei + ne2 
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< /(Mo, Ms, Z2\ Zi) + I(Mo, M2, Ml, Yi; Z2) + /(Mi; Fi jZa, Mq, M2) + nei + nea 
= /(Vf ; Zi) + /(V|; Z2) + I{Xi-Yi\Vl) + nei + nea, (104) 

where in (11021 ) we used the independence of (Mq, M2) and Mi, and in (11031 ) we used the fact that Z2 
is less degraded than Y2. 

Using the symmetry between {W2, Wi) and (Yi, y2)> an analogous argument can be used to prove (I24cl ). 
In order to prove (I23db . we use Fano's inequality to write 

n{RQ + Ri + R2 + R3)< I {Mo, M2 ; Zi , Z2) + /(Mi ; Fi , ^2) + /(M3 ; VFi , W2) + nei + ne2 + neg. (105) 

From (11051 ) we have 

n(/2o + R1 + R2 + R3) < /(Mo, M2; Zi, Z2) + /(Mi; Yi, Z2) + /(M3; n, 1^2) + nei + ne2 + neg 

(106) 

< /(Mo , M2 ; Zi , Z2) + /(Ml ; Fi , Z2 |Mo , M2) 

+ /(M3; Yi, W2IM0, M2, Ml) + nei + ne2 + nes (107) 
= /(Mo, M2; Zi, Z2) + I{Mi-Yi |Mo, M2) + /(A/i; Z2IM0, M2, Yi) 

+ /(M3; yilMo, M2, Ml) + /(M3; T^2|Mo, M2, Ml, Fi) 

+ nei + ne2 + ne3 

= /(Mo, M2; Zi, Z2) + /(Ml, M3; Yi |Mo, M2) + /(Mi; Z2IM0, M2, Fi) 
+ /(M3; H^2|Mo, M2, Ml, Fi) + /(Z2; niMo, M2) - /(Z2; niMo, M2) 

+ nei + ne2 + ne3 

(108) 

< /(Mo, M2; Z2) + /(Mo, M2; Z1IZ2) + I{MuM^- nlMo, M2, Z2) 

+ /(M3; t^2|Mo, M2, Ml, yi) + /(Z2; YilMo, M2) + /(A/i; Z2IM0, M2, Fi] 

+ nei + nt2 + ne3 

= /(Mo, M2, Fi; Z2) + /(Mo, M2; Zi IZ2) + /(Mi, M3; YijMo, M2, Z2) 
+ /(M3; iy2|Mo, M2, Ml, Yi) + /(Mi; Z2IM0, M2, Fi) 

+ nei + ne2 + ne3 

< /(Mo, M2, Fi, Mi; Z2) + /(Mo, M2, Z2; Zi) + /(Mi, M3; FijMo, M2, Z2) 
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+ I{M3;W2\Mo, M2, Mi,Yi) + nei + ne2 + nes 

= I{Vl; Z2) + I{V\;Zi) + I{Xi-Yi\Vl) + /(X2; t^2|V|) + nei + nea + neg, 

where in (1106b we have use the fact that Yi is less degraded than Wi, and Z2 is less degraded than 1^2- 
In (11071 ) we used the observation that Mq and M2 are independent of Mi and M3, and that Mi and M3 
are independent of each other. The term /(Z2; 1^ [Mq, M2) is added and subtracted in dlOSI ) in order to 
introduce Z2 in the conditioning of the second term in (I108I ). 

Using the symmetry between {W2, Wi) and (Yi, I2), an analogous argument can be used to prove (I24dl) . 

Appendix XI 

Application to the Gaussian Channel — Regioni 

In this section, we will show that Regioni is an outer bound on the capacity region. In order to do this 
we will show that for every achievable rate vector there exist power partitions (a, a', a") such that the 
inequalities in (|18b| )- (|18i| ) are satisfied. The argument will be based on invoking the inequalities in (l22l ) 
and (|23] ) in the case in which each subchannel is Gaussian. (The corresponding argument for Region2 is 
almost identical, and will be briefly discussed in Appendix Kill ) We begin by observing that [2] 



H{Yi) < - log(27re(Pi + nD) (109a) 

H{Zi) < ^ log((2^e(Pi + iVf )) (10%) 

H{W2) < ^ log((2^e(P2 + iV2 )) (109c) 

H{Z2) < ^log((27re(P2 + iV|))- (109d) 



In the following subsections we will specify the partitions a, a' and a" and we will employ those 
partitions and the entropy power inequality to provide the desired bounds. 

A. Specifying power partitions a, a' and a" 

1) Specifying a: Since conditioning reduces entropy, we conclude that there exist two non-negative 
reals a\ and satisfying a\ + af < 1 such that 

HiY,\Uf) = ^log(27re((al + al)Pi + N^)), (110) 

H{Yi\u!) = ^log(2^e(a}Pi + iVi)). (Ill) 

Similarly, there exist and a| satisfying a\ + <1 such that 

H{Z2\Ul) = ^log(27re((ai + al)P2 + iV|)), (112) 
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H{Z2\Ul) = ^log(27re(aiP2 + A^|))- (113) 

In (lllll ) we have used the fact that contains more information about Yi than lif, and that contains 
more information about Z2 than ■ This fact is immediately apparent from the definitions in (|2TI ). 

2j Specifying a': Because conditioning reduces entropy, there also exist non-negative reals ai,af,a2 
and a'2 such that + af < 1, i = 1, 2, and 

H{Yi\Mo, Z2) = H{Yi\Vl) = log(27re((a'/ + a'^)Pi + nI)), (114) 

F(t^2|Mo,Zi) = H{W2\Vl) = \og{2TTe{{a'^ + aq)P2 + Nl)), (115) 

H{Yi\Mo,M2,Z2) = HiYi\Vf) = log{2TT e{a'^ Pi + nI)) , (116) 

H{W2\Mo,M2,Yi,Mi) = H{W2\Vi) = log{27Te{a'i P2 + N^)), (117) 

where (11171) follows from the fact that Yi is a less degraded version of Zi. 

3) Specifying a": Using, once again, the fact that conditioning reduces entropy, one can find non- 
negative reals a'/\ a'{^, o'^ , a'^ such that a'l^ + a-'^ < 1, i = 1, 2, and 

H{Zi\Ul) = ^log(27re((af + af )Pi +iV2)), (Hg) 

H{Zi\Ul) = ^ log(27re(Qf Pi + ND), (119) 

H{W2\Ul) = ^ log(27re((a'2" + a^)P2 + N^)), (120) 

H{W2\lll) = ^ log(2^e(af P2 + A^2'))- (121) 

B. Applying the entropy power inequality 

1) Applying the entropy power inequality with a: Using the entropy power inequaUty one can show 
that 

H{Zi\Ul) > ^log(27re((al + al)Pi + N^)), (122) 
H{Zi\Uf) > ^log(27re(a}Pi + iVf)), (123) 
H{Wi\Uf) > I log(27re((ai + al)Pi + Nf)), (124) 
H{Wi\U^) > ^ log(27re(a}Pi + Nf)). (125) 



Similarly, we have 



H{W2\Ul) < ^ log(27re((ai + al)P2 + N^)), (126) 



November 3, 2009 



DRAFT 



43 

H{W2\Ui) < ^ log(27re(a^P2 + N^)), (127) 

where in (11261 ) and (11271 ) we have used the entropy power inequality in the reverse direction. Using the 
entropy power inequality on (II 121 ) and (11 131 ). we obtain 

H{Y2\Ul) > ^log(27re((a^ + al)P2 + iV|)), (128) 

H{Y2\Ul) > ^ log(27re(aiP2 + ND). (129) 
2j Applying the entropy power inequality with a' : 

H{Zi\Mo, Z2) = H{Zi\Vl) > log(27re((a'/ + af)Pi + TVf)) , (130) 

H{Z2\Mo,Zi) = H{Z2\Vl) > log(27Te{{a'i + a'i)P2 + Ni)^ (131) 

H{Zi\Mo,M2,Z2) = H{Zi\V^) > log{27Te{a'lPi+N^)), (132) 

H{Z2\Mo,M2,Yi,Mi) = H{Z2\Vl) > log{27T eia'i P2 + iV|)). (133) 
3) Applying the entropy power inequality with a": 

H{Y,\Uf) < -log(2^e((af + af )Pi + 7Vi)), (134) 

H{Wi\u!) > ^ log(2^e((af + af )Pi + Nf)), (135) 

H{Yi\U^) < ^ log(27re(Qf Pi + nD), (136) 

H{W,\Uf) > ^ log(2^e(Qf Pi + Nf)), (137) 

i?(^2|^/|) > ^ log(27re((a'2" + a'^)P2 + N^)), (138) 

H{Y2\Ul) > ^ log(2^e((a'2" + a'^)P2 + ND), (139) 

H{Z2\lll) > ^ log(2^e(a'2'iP2 + N^), (140) 

^-(1^21^/1) > ^ log(2^e(af P2 + ND). (141) 
Using (|109ab - (ll41b we now prove our target inequalities. 

C. Proving the converse of the inequalities in (I18bl )- (ll8cl) 

For this set of inequalities, we will apply the inequaUties in (11091 ). (I110b - (I113I ) and (|122|) - (ll29b 
to (I22al )- (l22dl ). As in (O, we will use C{x) to denote i log(l + x). 
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1 } Proving the converse of the first inequality in (llSbl ).' From (I22al ). we have 

ni?o < H{Yi) - H{Yi\Ul) + H{Y2) - H{Y2\Uf) + nei 

< ^ log(27re(Pi + N})) - ^ log(2^e((al + al)Pi + nD) + ^ log(27re(P2 + iV|)) 
- ^ log(27re((ai + a2)P2 + nD) + nei 

2j Proving the converse of the second inequality in (llSbl ).' From (I22bl ). we have 

i{Ro + ^i) < H{Yi) - H{Yi\Xi) + /7(y2) - H{Y2\Ul) + nei 



n 



< 5 log(27re(Pi + iVi)) - ^ log(27re(iV^ )) + ^ log(27re(P2 + iV|)) 



- - log(27re((Q^ + al)P2 + iV|)) + nei 



2 

5j Proving the converse of the third inequality in (llSbb ; Using (I22cl ). we have 

n(i?o + i?i + i?2) < Y2) + /(^^l; Z2\Ui) + /(Xi; Yi) + nei + ne2 

< H{Yi) - H{Y^\Xi) + H{Y2) - H{Y2\Ui) + H{Z2\Ul) 

- H{Z2\Ul) + nei + ne2 

<nC{^)+nC{ 3 "f^ 
- Vati;^ VAr| + (a2 + ai)P2 

+ ^ log(27re((Q^ + al)P2 + N^)) - ^ log(27re(a^P2 + iV|)) 
+ nei + ne2 

+ nei + ne2. 

4) Proving the converse of the inequality in (llScI ).- To prove the converse of this inequality we use (I22dl) 
to write 

n{Ro + R1+R2 + R3) <nC(^) +nC( ) + nC( 

+ ^(^212^1) - ^(^21X2) + nei + ne2 + neg 



<nC[^] +nC[ , % — ]+nC\ , — 

- \Nl) V iVf + + al)P2) V + alP2 
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+ ^ log(27re(a^P2 + N^)) - ^ log(27reiVj) 

+ nei + ne2 + nes, (142) 

where in (11421 ) we have used the upper bound on H{W2\U2) in (11271 ) and the fact that H{W2\X2) = 
§log(2^eiVi). 

D. Proving the converse of the inequalities in (1 1 8db - (l 1 8el ) 

For this set of inequalities, we will apply the inequaUties in (I109K (I114I) - (I115I ) and (I130I) - (I133I) 
to (I23ab-(l23dl). 

1 ) Proving the converse of the first inequality in (|18d| ).- Expressing ( |23a| ) in terms of the conditional 
entropy and using (11301 ) and (11311 ). one can show that 

nRo<nC(^ )+nC(^ "f^^ )+ne2, (143) 

where of = 1 - (of + af ), i = 1, 2. 

2j Proving the converse of the second inequality in (llSdl ); Expressing (I23bb in terms of the conditional 
entropy and using ( 11091 ). ( 11321 ) and ( 11331 ). we have 

3) Proving the converse of the third inequality in (llSdb ; Using (I23cl ). we have 

n(i?o + + ^2) < H{Z2) - H{Z2\Mo, M2, ^i, Mi) + H{Zi) - H{Zi\Mo, Ah, Z2) 

+ H{Yi\Mo, M2, Z2) - H{Yi \Mi,M^, Mq, M2, Z2) + n{ei + 62) (145) 
< ^ log((27re(P2 + iV|)) " ^ \og{2^e{a'^ P2 + iV|) + ^ log((27re(Pi + ND) 

TL Tt 71/ 

- - log(27re(a;iPi + ND) + - log(27re(a;iPi + ND) - - log(27reiVi) + n(ei + £2) 

4j Proving the converse of the inequality in (llSel ); Using (I23dl) . we have 

n(i?o + i?i + i?2 + i?3) < i^(^2) - H{Z2\Mq, M2, Ml, Fi) + if(Zi) - F(Zi|Mo, M2, Z2) + H{Y^\Mo, M2, Z2) 

- H{Yi\Mo, M2, Z2, Ml, M3) + //(T^slMo, M2, Fi, Ml) 
- H{W2\Mo, M2, Fi, Ml, M3) + n(ei + e2 + £3) 
< ^ log((27re(P2 + iV|)) " ^ log(27re(a'2iP2 + iV|) + ^ log(2^e(Pi + iVf)) 
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log(27re(a'/Pi + 7Vf)) 

, I Mn. Mr,. Zo. /Ifi . /Ifol -\- ^ 



+ ^ log(2^e(a'/Pi + nD) - H{Yi\Mo, M2, Z2, M,,Ms) + ^ log(27re(a'2iP2 + 



( W2 1 Mo , M2 , , Ml , M3 ) + n ( e 1 + e 2 + e 3 ) 



+ ^C(^) + nC(4^) + n(ei + 62 + 63), (147) 



where in (11471) we have used the fact that 

F(yi|Mo,M2,Z2,Mi,M3) > log{27TeNl), 

and 

i/(VF2|Mo,M2,yi,Mi,M3) > log(2^eiVj). 



E. Proving the converse of the inequalities in (1 1 8fl )-( 1 8g I 

For this set of inequalities we will apply the inequalities in (I109I ). (I118H121|) . (I134I )- (I141I) to (I22el) - 
(I22hl) . 



i ) Proving the converse of the first inequality in dlSfl l." 

ni?o < H{Wi) - H{Wi\Ul) + H{W2) - H{W2\Ul) + neg 

< - log(27re(Pi + Nf)) - - log(2^e(Aff + (af + af )Pi)) + - log(2^e(P2 + N^)) 
- ^ log(27re((4'i + )P2 + N^)) + ne^ 



2 j Proving the converse of the second inequality in (1 1 Sfl) ; Using (I22fl) we have 

n(iio + R3) < H{W2) - H{W2\X2) + H{Wi) - H{Wi\Uf) + neg 

< ^ log(27re(P2 + N^)) - \ \ogi:i^eN\) + ^ log(27re(Pi + iVf )) 
- ^ log(27re((af + af)Pi + iVf)) + neg 



Nl) ViV3 + (af + af )Pi 
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3 ) Proving the converse of the third inequality in (llSfl ).' In order to prove this inequality we have 



from (22g 



n{Ro + R2 + R3)) < H{Wi) - H{Wi\Uf) + H{Zi\Uf) - H{Zi\Ul) 

+ H{W2)- H{W2\X2) + ne2 + ne3 (148) 
< ^ log(27re(Pi + nD) - ^ log(27re((af + af )Pi + Nf)) 
+ ^ log(2^e((af + af )Pi + nD) - ^ log(27re(af A + Nf)) 
+ ^ log(2^e(P2 + Nl)) - ^ log(2^eiVi) + nea + neg (149) 



+ nC(^) +ne2 + ne3. (150) 



4j Proving the converse of the inequality in (18gl/ Using (I22hb . we have 



n(i?o + R1+R2 + Rs) < nC( . , "J'^^ + nCf "'"^^ 



+ ^^^(^) + ^(^il^i ) - ^(^il^i) + nei + nea + neg 



^) + ^ log(2vre(af Pi + iVi^)) - ^ log(2vreiVi) 



+ nei + ne2 + nes 



iVf + (af + af )Pi/ VAr2 + a'/iPi 

+ nC j + nC j + nei + ^^£2 + ne^. 

Appendix XII 
Application to the Gaussian Channel — REG10N2 

The application of the entropy power inequality to show the maximality of Region2 uses essentially 
the same methodology as that used in Appendix IXII for Regioni, but with the partitions a' chosen so as 
to satisfy the following equalities 

H{Yi\Xf) = ^ log (2^6 ((a'/ + a'?)Pi + iY^)), (151) 

H{W2\Xl) = ^ log (2^6 ((41 + )P2 + Nl)), (152) 
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H{Yi\X^) = ^ log(27re(a'/Pi + N^)), (153) 
H{W2\X^) = ^ log(27re(a'2'^'2 + N^))- (154) 



2 

Using these partitions along with the inequalities in ( |24a| )- (|24d| ) yields 



n{Ro + R1 + R2 + R3) < nC( \1 f/' + nC{ \' ' + nC[^-^ + C 



(156) 

2" 



+ n(ei + 62 + 63), (157) 



which is the desired converse. 
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